-- Logs begin at Fri 2022-06-03 14:35:12 UTC, end at Fri 2022-06-03 15:45:17 UTC. -- Jun 03 15:17:26.515069 dv-cinder-831247-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 15:17:26.522475 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 15:17:26.524479 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 15:17:26 2022] *** Jun 03 15:17:26.524479 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 15:17:26.524479 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 15:17:26.524479 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: nodename: dv-cinder-831247-16-iscsi Jun 03 15:17:26.524479 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: machine: x86_64 Jun 03 15:17:26.524479 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: clock source: unix Jun 03 15:17:26.524479 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: pcre jit disabled Jun 03 15:17:26.524479 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: detected number of CPU cores: 4 Jun 03 15:17:26.525022 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: current working directory: / Jun 03 15:17:26.525022 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: detected binary path: /usr/bin/uwsgi-core Jun 03 15:17:26.525022 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: your processes number limit is 47680 Jun 03 15:17:26.525022 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: your memory page size is 4096 bytes Jun 03 15:17:26.525022 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: detected max file descriptor number: 2048 Jun 03 15:17:26.525022 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: lock engine: pthread robust mutexes Jun 03 15:17:26.525022 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: thunder lock: enabled Jun 03 15:17:26.525022 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 15:17:26.525022 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 15:17:26.570917 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: Python main interpreter initialized at 0x558fe6ccc9c0 Jun 03 15:17:26.570917 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: python threads support enabled Jun 03 15:17:26.570917 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: your server socket listen backlog is limited to 100 connections Jun 03 15:17:26.570917 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: your mercy for graceful operations on workers is 90 seconds Jun 03 15:17:26.571365 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 15:17:26.571365 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: *** Operational MODE: preforking *** Jun 03 15:17:26.571647 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: *** uWSGI is running in multiple interpreter mode *** Jun 03 15:17:26.571647 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: spawned uWSGI master process (pid: 103176) Jun 03 15:17:26.571857 dv-cinder-831247-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 15:17:26.572461 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: spawned uWSGI worker 1 (pid: 103179, cores: 1) Jun 03 15:17:26.572785 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: spawned uWSGI worker 2 (pid: 103180, cores: 1) Jun 03 15:17:26.572953 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 15:17:27.791739 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 15:17:27.793896 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 15:17:28.512173 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 15:17:28.512173 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: from cryptography.utils import int_from_bytes Jun 03 15:17:28.512515 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 15:17:28.512515 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: from cryptography.utils import int_from_bytes Jun 03 15:17:28.515461 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 15:17:28.515461 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: from cryptography.utils import int_from_bytes Jun 03 15:17:28.515799 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 15:17:28.515799 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: from cryptography.utils import int_from_bytes Jun 03 15:17:31.136719 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 15:17:31.137293 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 15:17:31.137373 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 15:17:31.137706 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 15:17:31.137775 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 15:17:31.137850 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 15:17:31.138065 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 15:17:31.138200 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 15:17:31.138427 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 15:17:31.138563 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.138702 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 15:17:31.138830 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.139643 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.139756 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.139968 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.140070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.140286 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.140391 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.140610 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.140711 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.140931 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.141026 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.141237 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.141335 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.141555 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.141660 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.141812 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.141907 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.142128 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.142227 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.142424 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.142545 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-16-iscsi {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.142762 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.142878 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.143102 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.143200 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-16-iscsi {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.143391 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.143490 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.143692 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.143838 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.144003 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.144098 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.144325 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.144431 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.144623 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.144803 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.144939 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.145119 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.145520 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.145650 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.145767 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.145886 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.146022 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.146139 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.146325 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.146458 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.146656 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.146809 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.146990 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.147186 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.147349 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.147444 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.147598 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.147743 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.147908 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.148067 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.148205 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.148380 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.148514 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.148784 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-16-iscsi {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.148885 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.149102 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.149210 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-16-iscsi {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.149414 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.149512 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.149725 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.149825 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.150083 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.150234 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.150437 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.150584 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.150775 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.150872 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.151098 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.151205 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.151412 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.151505 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.151810 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.151940 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.152129 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.152297 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.152449 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.152567 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.152750 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.152838 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.153065 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.153165 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.153386 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.153543 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.153691 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.153850 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.154003 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.154161 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.154306 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.154817 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.154966 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.155113 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.155306 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.155460 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.155460 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.155722 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.155879 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.156026 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.156182 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.156327 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.156469 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.156614 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.156758 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.156962 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.157122 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.157268 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.157420 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.157561 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.157714 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.157869 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.158008 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.158147 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.158289 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.158430 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.158618 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.158710 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.158800 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.158936 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.159021 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.159100 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.159262 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.159407 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.159555 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.159709 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.159872 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.160016 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.160170 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.160324 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.160466 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.160614 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.160753 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.160888 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.161039 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.161134 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.161329 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.161488 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.161645 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.161804 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.161946 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.162099 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.162291 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.162441 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.162637 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.162802 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.162947 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.163097 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.163194 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.163284 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.163486 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.163593 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.163793 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.163888 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.164115 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.164211 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.164434 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.164531 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.164741 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.164834 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.165043 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.165129 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.165349 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.165438 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.165668 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.165756 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.165970 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.166056 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.166220 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.166309 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.166511 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.166667 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.166831 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.166918 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.167136 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.167224 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.167446 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.167531 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.167750 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.167835 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.168056 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.168161 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.168351 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.168478 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.168658 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.168967 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.169069 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.169276 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.169480 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.169567 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.169876 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.170050 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.170214 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.170516 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.170685 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.170846 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.171153 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.171319 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.171475 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.171773 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.171860 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.172088 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.172353 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.172449 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.172687 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.172934 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.173033 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.173302 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.173485 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.173612 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.173918 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.174044 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.174242 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.174588 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.174761 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.174864 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.175001 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.175190 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.175330 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.175515 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.175641 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.175835 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.175950 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.176156 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.176253 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.176488 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.176578 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.176805 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.176893 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.177121 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.177208 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.177447 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.177533 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.177752 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.177841 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.178055 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.178150 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.178359 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.178455 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.178700 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.178790 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.179005 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.179135 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.179311 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.179447 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.179615 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.179731 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.179912 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.180006 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.180231 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.180327 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.180536 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.180629 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.180843 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.180929 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.181147 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.181242 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.181450 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.181543 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.181753 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.181840 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.182056 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.182145 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.182360 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.182448 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.182687 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.182793 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.183063 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.183159 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.183386 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.183472 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.183711 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.183798 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.184027 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.184114 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.184333 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.184419 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.184641 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.184736 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.184963 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:17:31.185059 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.185272 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.185358 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.185585 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.185682 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.186412 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.186511 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.186756 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.186846 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.187078 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.187235 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.187417 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.187542 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.187732 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.187824 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.188044 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.188152 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.188357 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.188454 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.188665 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.188779 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.188983 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.189080 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.189295 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.189411 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.189602 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.189690 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.189911 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.190017 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.190224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.190312 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.190569 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.190675 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.190890 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.190981 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.191205 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.191292 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.191522 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.191610 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.191835 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.191994 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.192135 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.192304 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.192442 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.192579 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.192747 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.192888 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.193056 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.193190 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.193378 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.193516 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.193735 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.193873 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.194024 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.194163 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.194314 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.194464 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.194630 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.194780 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.194917 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.195061 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.195197 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.195345 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.195532 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.195672 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.195845 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.195993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.196160 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.196306 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.196468 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.196605 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.196781 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.196928 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.197071 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.197220 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.197381 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.197542 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.197675 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.197830 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.197977 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.198122 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.198259 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.198396 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.198582 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.198760 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.198913 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.199049 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.199194 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.199333 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.199466 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.199611 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.199765 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.199902 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.200075 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.200214 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.200411 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.200549 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.200705 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.200846 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.201016 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.201156 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.201328 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.201499 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.202197 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.202379 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.202564 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.202711 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.202853 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.202954 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.203147 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.203281 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.203453 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.203595 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.203781 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.203929 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.204092 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.204231 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.204400 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.204540 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.204710 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.204861 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.205020 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.205157 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.205325 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.205463 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.205628 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.205771 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.205938 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.206072 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.206243 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.206392 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.206578 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.206713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.206861 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.206996 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.207170 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.207313 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.207458 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.207550 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.207782 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.207927 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.208085 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.208233 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.208377 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.208521 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.208685 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.208826 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.208993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.209126 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.209302 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.209451 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.209611 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.209703 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.209920 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.210021 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.210255 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.210418 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.210556 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.210648 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.210868 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.210957 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.211170 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.211245 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.211483 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.211558 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.211789 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.211878 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.212095 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.212171 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.212399 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.212474 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.212703 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.212787 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.213006 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.213082 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.213314 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.213391 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.213615 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.213693 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.213916 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.213991 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.214216 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.214292 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.214515 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.214612 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.214884 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.215024 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.215490 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.215576 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.215576 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.215737 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.215817 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217027 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217137 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217218 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217310 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217393 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217473 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217553 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217632 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217769 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217871 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.217962 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.218044 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.218130 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.218211 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.218300 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.218382 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.218461 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.218574 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.218671 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.218851 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.218954 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.219171 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.219260 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.219493 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.219579 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.219806 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.219906 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.220115 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.220200 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.220420 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.220506 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.220729 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.220829 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.221036 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.221123 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.221347 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.221437 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.221666 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.221754 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.221977 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.222067 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.222293 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.222388 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.222623 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.222715 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.222938 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.223023 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.223242 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.223340 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.223550 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.223637 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.223857 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.223944 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.224165 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.224252 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.224486 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.224575 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.225862 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.229489 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.229620 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.229856 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.229995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.230121 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.230121 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.230310 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.230310 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.230597 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.230597 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.230802 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.230924 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.231052 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.231166 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.231290 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.231401 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.231522 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.231679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.231820 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.231961 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.232109 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.232257 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.232378 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.232484 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.232640 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.232864 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.233038 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.233186 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.233320 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.233450 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.233579 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.233719 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.233843 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.233843 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.234097 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.234227 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.234341 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.234493 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.234721 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.234862 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.234988 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.235116 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.235245 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.235407 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.235512 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.235620 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.235721 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.235808 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.235932 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.236024 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.236101 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.236235 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.236352 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.236452 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.236568 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.236675 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.236793 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.236913 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.237027 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.237148 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.237260 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.237362 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.237472 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.237572 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.237676 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.237796 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.237904 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.237992 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.238080 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.238179 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.238274 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.238360 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.238460 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.238566 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.238657 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.238753 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.238853 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.238968 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239063 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239135 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239200 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239263 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239327 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239398 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239542 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239661 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239772 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239869 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.239977 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.240078 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.240174 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.240271 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.240376 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.240466 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.240560 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.240705 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.240810 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.240924 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.241012 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.241112 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.241204 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.241339 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.241446 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.241557 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.241667 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.241783 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.241905 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242005 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242119 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242234 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242333 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242428 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242560 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242650 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242738 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242836 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242925 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.242997 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.243077 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.243145 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.243241 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.243366 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.243459 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.243565 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.243660 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.243871 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.244077 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.244238 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.244421 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.244577 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.244686 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.244760 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.244915 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.245077 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.245241 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.245524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.245699 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.245877 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.246058 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.246233 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.246401 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.246608 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.246752 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.246884 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.246971 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.247112 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.247242 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.247419 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.247593 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.247744 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.247991 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.248202 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.248961 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.249227 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.249307 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.249627 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.249805 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.252079 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.252326 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.252490 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.252852 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.253175 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.253404 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.253635 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.253635 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.254012 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.254012 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.254376 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.254376 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.254827 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.254827 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.255211 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.255323 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.255471 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.255549 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.255626 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.255709 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.255779 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.255854 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.255923 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.255996 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256064 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256130 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256196 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256274 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256343 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256409 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256474 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256548 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256629 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256699 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256773 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256841 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256907 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.256984 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257060 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257130 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257203 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257278 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257346 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257413 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257487 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257555 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257637 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257710 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257785 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257860 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.257937 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258006 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258071 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258143 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258211 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258286 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258354 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258420 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258485 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258582 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258654 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258729 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.258797 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.259357 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.259513 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.259651 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.259790 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.259952 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.260084 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.260219 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.260356 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.260494 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.260633 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.260786 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.260925 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.261063 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.261202 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.261335 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.261482 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.261581 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.261731 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.261870 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.262015 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.262160 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.262308 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.262440 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.262577 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.262694 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.262804 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.262804 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.263302 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.263393 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.263601 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.263693 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.263841 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.264057 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.264653 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.264726 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.264793 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.264859 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.265152 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.265313 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.265452 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.265594 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.265689 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.265818 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.265903 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.266039 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.266126 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.266295 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.266389 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.266622 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.266730 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.266929 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.267027 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.267232 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.267397 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.267543 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.267755 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.267932 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.268030 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.268113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.268194 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.268412 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.268517 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.268719 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.268816 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.269017 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.269105 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.269314 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.269411 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.269616 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.269703 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.269912 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.269999 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.270209 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.270307 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.270510 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.270655 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.270833 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.270925 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.271144 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.271315 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.271464 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.271683 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.271879 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.272076 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.272276 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.272363 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.272363 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.272840 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.273027 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.273357 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.273533 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.273881 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.274073 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.274268 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.274446 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.274617 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.274899 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.275106 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.275332 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.275514 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.275784 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.275873 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.276326 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.276539 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.276719 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.276840 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.277130 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.277355 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.277536 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.277625 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.277939 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.278089 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.278446 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.278716 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.278880 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.279041 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.279224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.279402 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.279511 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.279883 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.280300 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.280484 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.280737 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.280832 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.280916 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281062 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281150 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281230 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281311 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281390 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281478 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281568 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281656 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281738 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281818 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281898 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.281991 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282074 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282161 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282253 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282336 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282416 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282505 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282604 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282685 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282778 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282861 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.282941 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283029 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283111 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283190 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283276 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283358 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283446 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283536 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283625 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283706 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283838 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.283923 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.284000 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.284076 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.284192 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.284333 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.284420 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.284489 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.284572 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.284695 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.284797 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.284924 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.285017 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.285144 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.285238 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.285364 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.285454 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.285590 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.285719 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.285892 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.286077 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.286198 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.286389 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.286486 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.286729 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.286833 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.287055 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.287156 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.287341 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.287433 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.287657 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.287758 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.287973 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.288070 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.288267 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.288367 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.288554 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.288670 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.288862 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.288973 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.289272 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.289367 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.289576 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.289667 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.289881 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.289974 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.290183 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.290273 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.290603 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.290731 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.290821 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.290939 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.291115 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.291230 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.291423 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.291521 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.291722 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.291864 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.292020 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.292153 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.292436 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.292655 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.292800 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.292948 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.293099 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.293248 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.293410 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.293552 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.293704 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.293853 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.293997 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.294138 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.294289 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.294442 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.294632 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.294782 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.294923 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.295084 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.295329 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.295475 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.295657 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.296290 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.296518 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.296606 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.296677 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.296752 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.296820 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.296894 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.296971 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.297045 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.297327 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.297468 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.297682 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.297871 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.298096 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.298271 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.298360 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.298463 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.298635 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.298773 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.298968 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.299150 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.299301 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.299474 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.299663 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.299803 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.299931 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.300062 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.300203 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.300333 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.300525 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.300679 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.300809 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.300809 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.301226 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.301362 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.301485 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.301595 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.301711 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.301795 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.301874 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.301951 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.302019 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.302237 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.302327 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.302560 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.302667 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.302877 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.302969 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.303206 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.303313 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.303510 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.303612 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.303825 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.303905 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.304140 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.304217 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.304452 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.304531 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.304757 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.304834 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.305060 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.305147 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.305457 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.305559 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.305667 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.305765 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.305985 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.306095 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.306283 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.306374 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.306618 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.306712 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.306929 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.307037 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.307231 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.307320 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.307530 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.307617 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.307849 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.307945 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.308155 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.308252 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.308457 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.308554 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.308759 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.308849 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.309077 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.309173 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.309392 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.309480 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.309712 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.309822 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.310016 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.310104 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.310333 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.310432 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.310666 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.310761 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.311491 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.311583 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.311880 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.311986 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.312085 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.312158 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.312421 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.312523 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.312720 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.312826 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.313033 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.313122 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.313338 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.313427 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.313649 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.313792 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.313953 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.314043 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.314259 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.314349 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.314633 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.314859 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.314948 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.315030 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.315188 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.315278 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.315490 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.315589 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.315793 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.315882 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.316105 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.316205 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.316405 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.316504 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.316703 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.316793 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.317004 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.317092 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.317304 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.317402 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.317605 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.317693 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.317902 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.317998 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.318224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.318314 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.318541 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.318644 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.318863 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.318960 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.319164 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.319254 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.319481 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.319570 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.319786 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.319885 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.320085 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.320174 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.320388 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.320546 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.320705 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.320945 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.321070 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.321157 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.321295 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.321386 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.321625 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.321741 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.321940 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.322030 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.322258 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.322347 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.322610 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.322716 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.322920 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.323009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.323236 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.323323 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.323548 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.323637 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.323859 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.323947 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.324173 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.324426 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.324528 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.324756 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.324853 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.325071 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.325161 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.325382 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.325478 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.325686 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.325774 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.325996 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.326125 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.326304 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.326400 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.327195 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.327295 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.327576 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.327747 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.327850 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.328072 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.328239 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.328382 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.328471 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.328691 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.328858 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.328999 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.329089 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.329311 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.329410 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.329618 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.329726 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.329924 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.330013 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.330228 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.330327 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.330601 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.330714 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.330865 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.330962 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.331194 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.331283 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.331512 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.331652 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.331835 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.331931 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.332146 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.332248 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.332464 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.332554 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.332772 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.332862 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.333081 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.333178 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.333389 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.333477 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.333700 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.333787 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.334011 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.334109 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.334320 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.334410 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.334657 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.334761 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.334968 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.335058 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.335280 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.335369 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.335589 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.335678 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.335896 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.335986 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.336205 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.336293 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.336514 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.336649 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.336819 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.336908 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.337123 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.337332 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.337422 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.337646 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.337737 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.337979 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.338075 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.338309 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.338398 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.338660 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.338759 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.338965 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.339055 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.339276 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.339382 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.339586 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.339686 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.339889 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.340098 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.340187 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.340406 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.340496 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.340736 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.340832 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.341056 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.341144 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.341377 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.341465 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.341688 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.341828 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.342003 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.342191 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.342374 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.342563 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.342714 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.342854 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.342968 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.343180 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.343312 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.343526 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.343623 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.343827 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.343917 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.344147 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.344239 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.344461 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.344550 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.344760 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.344848 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.345068 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.345158 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.345368 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.345464 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.345689 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.345894 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.345992 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.346249 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.346402 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.346596 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.346740 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.346901 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.347006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.347200 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.347289 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.347514 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.347604 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.347814 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.347903 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.348123 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.348210 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.348426 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.348521 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.348727 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.348822 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.349038 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.349125 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.349343 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.349430 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.349644 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.349749 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.349945 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.350042 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.350251 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.350339 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.350571 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.350665 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.350876 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.350976 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.351177 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.351273 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.351474 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.351562 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.351782 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.351922 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.352084 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.352182 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.352387 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.352479 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.352686 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.352782 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.352989 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.353085 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.353288 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.353375 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.353583 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.353670 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.353884 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.353980 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.354182 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.354271 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.354494 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.354672 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.354910 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.355061 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.355246 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.355393 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.355556 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.355647 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.355879 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.355970 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.356175 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.356263 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.356481 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.356581 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.356827 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.356933 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.357142 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.357230 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.357442 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.358174 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.358352 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.358523 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.358632 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.358868 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.358956 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.359184 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.359288 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.359492 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.359589 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.359828 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.359927 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.360100 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.360188 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.360404 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.360501 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.360729 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.360947 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.361050 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.361278 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.361367 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.361592 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.361681 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.361920 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.362072 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.362224 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.362321 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.362557 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.362662 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.362857 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.362945 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.363156 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.363245 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.363462 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.363549 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.363769 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.363857 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.364074 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.364162 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.364378 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.364464 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.364680 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.364768 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.364989 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.365076 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.365293 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.365393 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.365596 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.365684 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.365901 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.365991 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.366205 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.366306 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.366508 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.366654 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.366843 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.366969 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.367136 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.367239 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.367441 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.367530 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.367753 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.367848 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.368071 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.368164 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.368389 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.368477 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.368703 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.368791 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.369004 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.369141 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.369314 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.369432 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.369621 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.369748 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.370261 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.371709 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.371790 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.371860 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.371945 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372042 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372127 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372196 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372263 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372329 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372404 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372480 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372548 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372620 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372620 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372740 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372740 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372864 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372931 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.372995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.373136 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.373222 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.373964 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.374069 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.374295 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.374393 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.374627 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.374724 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.374936 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.375014 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.375248 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.375343 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.375551 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.375637 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.375865 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.375964 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.376173 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.376276 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.376477 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.376581 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.376782 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.376892 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.377088 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.377197 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.377392 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.377500 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.377694 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.377794 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.377994 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.378094 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.378303 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.378415 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.378629 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.378727 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.378932 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.379031 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.379232 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.379348 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.379528 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.379625 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.379827 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.379942 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.380126 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.380236 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.380422 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.380522 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.380720 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.380819 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.381019 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.381123 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.381315 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.381420 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.381614 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.381721 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.381907 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.382002 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.382206 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.382306 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.382504 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.382624 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.382823 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.382923 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.383127 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.383321 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.383411 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.383492 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.383711 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.383813 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.384008 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.384115 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.384307 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.384468 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.384600 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.384695 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.384932 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.385025 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.385264 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.385363 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.385575 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.385675 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.385897 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.385986 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.386208 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.386307 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.386519 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.386641 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.386965 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.387069 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.387228 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.387406 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.387544 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.387634 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.387855 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.387945 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.388160 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.388252 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.388487 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.388577 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.388797 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.388887 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.389687 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.389784 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.389999 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.390099 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.390307 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.390416 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.390632 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.390727 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.390939 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.391061 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.391257 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.391355 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.391568 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.391665 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.391865 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.391953 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.392184 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.392285 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.392498 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.392627 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.392815 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.392913 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.393120 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.393217 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.393429 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.393538 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.393749 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.393838 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.394057 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.394155 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.394361 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.394449 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.394701 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.394792 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.395010 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.395102 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.395319 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.395410 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.395633 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.395729 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.395944 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.396035 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.396267 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.396356 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.396592 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.396689 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.396895 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.397049 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.397139 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 15:17:31.397230 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.397525 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.397874 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.398186 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.398560 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.398877 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.399191 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.399502 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.399804 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:17:31.400043 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 15:17:31.455019 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO dbcounter [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Registered counter for database nova_api Jun 03 15:17:31.458384 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO dbcounter [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Registered counter for database nova_api Jun 03 15:17:31.478186 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:17:31.480435 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG oslo_db.sqlalchemy.engines [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:17:31.486611 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writer thread running {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:17:31.487979 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG dbcounter [-] [103179] Writer thread running {{(pid=103179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:17:31.543494 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.context [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d0d96d0-a575-4f71-9a90-c4114fd48e50(cell1) {{(pid=103180) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 15:17:31.545851 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.context [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d0d96d0-a575-4f71-9a90-c4114fd48e50(cell1) {{(pid=103179) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 15:17:31.547948 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:17:31.549526 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:17:31.550013 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG oslo_concurrency.lockutils [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:17:31.550316 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:17:31.551629 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG oslo_concurrency.lockutils [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:17:31.552292 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:17:31.552397 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG oslo_concurrency.lockutils [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:17:31.554292 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO dbcounter [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Registered counter for database nova_cell0 Jun 03 15:17:31.554385 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG oslo_concurrency.lockutils [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:17:31.556333 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO dbcounter [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Registered counter for database nova_cell0 Jun 03 15:17:31.558321 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO dbcounter [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Registered counter for database nova_cell1 Jun 03 15:17:31.560283 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO dbcounter [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Registered counter for database nova_cell1 Jun 03 15:17:31.570565 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:17:31.570565 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:17:31.570841 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG oslo_db.sqlalchemy.engines [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:17:31.572922 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG oslo_db.sqlalchemy.engines [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:17:31.574984 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writer thread running {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:17:31.575906 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG dbcounter [-] [103179] Writer thread running {{(pid=103179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:17:31.577557 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writer thread running {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:17:31.713952 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG dbcounter [-] [103179] Writer thread running {{(pid=103179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:17:31.724411 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO dbcounter [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Registered counter for database nova_cell0 Jun 03 15:17:31.724567 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO dbcounter [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Registered counter for database nova_cell0 Jun 03 15:17:31.733488 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:17:31.736834 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG oslo_db.sqlalchemy.engines [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:17:31.738112 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writer thread running {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:17:31.741218 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG dbcounter [-] [103179] Writer thread running {{(pid=103179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:17:32.201108 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: WARNING keystonemiddleware.auth_token [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 15:17:32.202607 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: WARNING keystonemiddleware.auth_token [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 15:17:32.209087 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: WARNING keystonemiddleware.auth_token [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 15:17:32.210421 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: WARNING keystonemiddleware.auth_token [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 15:17:32.431104 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: WARNING keystonemiddleware.auth_token [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 15:17:32.431325 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: WARNING keystonemiddleware.auth_token [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 15:17:32.437866 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: WARNING keystonemiddleware.auth_token [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 15:17:32.438009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: WARNING keystonemiddleware.auth_token [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 15:17:32.443046 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558fe6ccc9c0 pid: 103180 (default app) Jun 03 15:17:32.443155 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558fe6ccc9c0 pid: 103179 (default app) Jun 03 15:17:32.445329 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:17:32.446549 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-d0d7095d-3e89-4967-91ef-4b94f2bbac89 None None] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Jun 03 15:17:32.446964 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 788 bytes} [Fri Jun 3 15:17:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:18:56.232027 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:18:56.234296 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003467 Jun 03 15:18:56.234901 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 1/2] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:18:56 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:18:56.253282 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG dbcounter [-] [103179] Writing DB stats nova_api:SELECT=3 {{(pid=103179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:18:56.254201 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG dbcounter [-] [103179] Writing DB stats nova_cell0:SELECT=3 {{(pid=103179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:18:56.255141 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG dbcounter [-] [103179] Writing DB stats nova_cell1:SELECT=3 {{(pid=103179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:18:56.255868 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG dbcounter [-] [103179] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:18:56.712450 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-70dc8483-dd7a-4cea-b1fb-cc4755932dd7 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:18:56.747121 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-70dc8483-dd7a-4cea-b1fb-cc4755932dd7 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.504002 Jun 03 15:18:56.763072 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 2/3] 10.222.0.93 () {60 vars in 1291 bytes} [Fri Jun 3 15:18:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:18:59.160463 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:18:59.161489 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-b5b1b27c-031c-4cef-aeec-a5267dee6b34 None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 03 15:18:59.161897 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 2/4] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:18:59.242181 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c99e1ddd-5a85-4989-ac99-c0b8b7b92e9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "vcpus": 1, "name": "cirros256", "ram": 256, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:18:59.261376 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 15:18:59.261376 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: warnings.warn(msg) Jun 03 15:18:59.292326 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c99e1ddd-5a85-4989-ac99-c0b8b7b92e9c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.123222 Jun 03 15:18:59.292891 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 3/5] 10.222.0.93 () {64 vars in 1282 bytes} [Fri Jun 3 15:18:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:18:59.314382 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writing DB stats nova_api:SELECT=3 {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:18:59.316306 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writing DB stats nova_cell0:SELECT=3 {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:18:59.317640 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writing DB stats nova_cell1:SELECT=3 {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:18:59.319211 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:18:59.538321 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-bb53bb85-3b3f-47ac-a761-36c2abeb5e6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:18:59.541055 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 15:18:59.541055 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: warnings.warn(msg) Jun 03 15:18:59.610616 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-bb53bb85-3b3f-47ac-a761-36c2abeb5e6a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.305473 Jun 03 15:18:59.611215 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 3/6] 10.222.0.93 () {64 vars in 1335 bytes} [Fri Jun 3 15:18:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:19:01.997072 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c99e1ddd-5a85-4989-ac99-c0b8b7b92e9c admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:01.998079 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c99e1ddd-5a85-4989-ac99-c0b8b7b92e9c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 03 15:19:01.998508 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 4/7] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:02.121277 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-f39a81e0-9ae4-429c-b018-a48ab09dbbe0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "name": "ds512M"}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:02.139904 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 15:19:02.139904 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: warnings.warn(msg) Jun 03 15:19:02.162820 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-f39a81e0-9ae4-429c-b018-a48ab09dbbe0 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157760 Jun 03 15:19:02.164537 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 4/8] 10.222.0.93 () {64 vars in 1282 bytes} [Fri Jun 3 15:19:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:19:02.176172 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-1b0b532d-ac7a-4060-a662-4ec7f5809a44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:02.177664 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 15:19:02.177664 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: warnings.warn(msg) Jun 03 15:19:02.237972 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-1b0b532d-ac7a-4060-a662-4ec7f5809a44 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063267 Jun 03 15:19:02.237972 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 5/9] 10.222.0.93 () {64 vars in 1335 bytes} [Fri Jun 3 15:19:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:19:04.758224 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-f39a81e0-9ae4-429c-b018-a48ab09dbbe0 admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:04.759277 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-f39a81e0-9ae4-429c-b018-a48ab09dbbe0 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 03 15:19:04.759882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 5/10] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:04.857021 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-3121e892-14fb-47d0-a797-e2fa53a2f7f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "disk": 10, "vcpus": 1}} {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:04.883440 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-3121e892-14fb-47d0-a797-e2fa53a2f7f4 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.116938 Jun 03 15:19:04.891918 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 6/11] 10.222.0.93 () {64 vars in 1282 bytes} [Fri Jun 3 15:19:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:19:04.897165 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-0f04016e-3284-457c-a8de-0441586394c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:04.928258 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-0f04016e-3284-457c-a8de-0441586394c1 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034645 Jun 03 15:19:04.938566 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 6/12] 10.222.0.93 () {64 vars in 1335 bytes} [Fri Jun 3 15:19:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:19:07.634231 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-3121e892-14fb-47d0-a797-e2fa53a2f7f4 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:07.635320 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-3121e892-14fb-47d0-a797-e2fa53a2f7f4 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 03 15:19:07.635717 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 7/13] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:19:07.703753 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-c66cac1a-e076-430f-9181-caca523f78dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "ram": 2048, "name": "ds2G"}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:07.721937 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-c66cac1a-e076-430f-9181-caca523f78dd admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079288 Jun 03 15:19:07.722527 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 7/14] 10.222.0.93 () {64 vars in 1282 bytes} [Fri Jun 3 15:19:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:19:07.738375 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-337059b1-b12d-4ca0-a736-e2e16790fe85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:07.793010 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-337059b1-b12d-4ca0-a736-e2e16790fe85 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061359 Jun 03 15:19:07.793620 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 8/15] 10.222.0.93 () {64 vars in 1335 bytes} [Fri Jun 3 15:19:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:19:10.236248 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-c66cac1a-e076-430f-9181-caca523f78dd admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:10.237271 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-c66cac1a-e076-430f-9181-caca523f78dd admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002523 Jun 03 15:19:10.237944 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 8/16] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:10.309148 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-edcd758c-b218-49b1-aeba-2be6922be950 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "name": "ds4G"}} {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:10.332293 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-edcd758c-b218-49b1-aeba-2be6922be950 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087471 Jun 03 15:19:10.340439 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 9/17] 10.222.0.93 () {64 vars in 1282 bytes} [Fri Jun 3 15:19:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:19:10.347042 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-2468f6df-e380-475d-835f-2c38a9e256f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:10.376321 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-2468f6df-e380-475d-835f-2c38a9e256f4 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034205 Jun 03 15:19:10.376915 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 9/18] 10.222.0.93 () {64 vars in 1335 bytes} [Fri Jun 3 15:19:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:19:12.687098 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-edcd758c-b218-49b1-aeba-2be6922be950 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:12.688120 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-edcd758c-b218-49b1-aeba-2be6922be950 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 03 15:19:12.688685 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 10/19] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:12.750972 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-83ed33a0-6d1b-4535-bb8d-926fb9c31e81 admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:12.775414 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-83ed33a0-6d1b-4535-bb8d-926fb9c31e81 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080443 Jun 03 15:19:12.776146 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 10/20] 10.222.0.93 () {60 vars in 1291 bytes} [Fri Jun 3 15:19:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:19:15.125333 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-edcd758c-b218-49b1-aeba-2be6922be950 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:15.126390 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-edcd758c-b218-49b1-aeba-2be6922be950 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jun 03 15:19:15.127005 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 11/21] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:15.195970 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-0b203e7e-a50b-4415-9549-790af9a4d8d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:15.220865 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-0b203e7e-a50b-4415-9549-790af9a4d8d8 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087689 Jun 03 15:19:15.221544 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 11/22] 10.222.0.93 () {64 vars in 1282 bytes} [Fri Jun 3 15:19:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:19:15.238795 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-d95c759c-e499-41b8-bfad-2ceb98500ff7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:15.271979 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-d95c759c-e499-41b8-bfad-2ceb98500ff7 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038091 Jun 03 15:19:15.272972 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 12/23] 10.222.0.93 () {64 vars in 1332 bytes} [Fri Jun 3 15:19:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:19:17.683118 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-0b203e7e-a50b-4415-9549-790af9a4d8d8 admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:17.684226 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-0b203e7e-a50b-4415-9549-790af9a4d8d8 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Jun 03 15:19:17.684704 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 12/24] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:17.754937 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-555bfb37-66f1-4c70-b1c4-2cdfda183433 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:17.776181 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-555bfb37-66f1-4c70-b1c4-2cdfda183433 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079072 Jun 03 15:19:17.776884 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 13/25] 10.222.0.93 () {64 vars in 1282 bytes} [Fri Jun 3 15:19:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:19:17.792940 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-ea5643d9-2f96-4537-b31e-ba8aa006de90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:17.820110 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-ea5643d9-2f96-4537-b31e-ba8aa006de90 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031804 Jun 03 15:19:17.820859 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 13/26] 10.222.0.93 () {64 vars in 1332 bytes} [Fri Jun 3 15:19:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:19:20.237899 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-555bfb37-66f1-4c70-b1c4-2cdfda183433 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:20.238981 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-555bfb37-66f1-4c70-b1c4-2cdfda183433 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 03 15:19:20.239383 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 14/27] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:19:20.300610 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-b87c0ddd-30b7-42cd-9ed5-ad05a17a9d0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:20.325627 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-b87c0ddd-30b7-42cd-9ed5-ad05a17a9d0e admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080138 Jun 03 15:19:20.328025 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 14/28] 10.222.0.93 () {64 vars in 1282 bytes} [Fri Jun 3 15:19:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 15:19:20.341039 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-56f2d11d-d859-4365-b83a-ef88c2bd3c47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:20.369073 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-56f2d11d-d859-4365-b83a-ef88c2bd3c47 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032795 Jun 03 15:19:20.369846 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 15/29] 10.222.0.93 () {64 vars in 1332 bytes} [Fri Jun 3 15:19:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:19:22.694869 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-b87c0ddd-30b7-42cd-9ed5-ad05a17a9d0e admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:22.695890 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-b87c0ddd-30b7-42cd-9ed5-ad05a17a9d0e admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 03 15:19:22.696292 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 15/30] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:22.758272 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-836fd86e-b049-4eb9-995e-317cf1886ad6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80}} {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:22.778199 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-836fd86e-b049-4eb9-995e-317cf1886ad6 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075855 Jun 03 15:19:22.778800 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 16/31] 10.222.0.93 () {64 vars in 1282 bytes} [Fri Jun 3 15:19:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 15:19:22.793314 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-3ef1530c-e346-4711-9a35-261c9fc49f4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:22.818808 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-3ef1530c-e346-4711-9a35-261c9fc49f4d admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029595 Jun 03 15:19:22.819698 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 16/32] 10.222.0.93 () {64 vars in 1332 bytes} [Fri Jun 3 15:19:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:19:25.266670 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-836fd86e-b049-4eb9-995e-317cf1886ad6 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:25.268244 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-836fd86e-b049-4eb9-995e-317cf1886ad6 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Jun 03 15:19:25.268830 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 17/33] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:25.350202 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-cd558ec8-b424-4b99-ac17-9527d020c51b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:25.370223 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-cd558ec8-b424-4b99-ac17-9527d020c51b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.095417 Jun 03 15:19:25.370807 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 17/34] 10.222.0.93 () {64 vars in 1282 bytes} [Fri Jun 3 15:19:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:19:25.384000 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-54dc4933-2302-4e4d-986b-b1ee9819a7bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:25.410851 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-54dc4933-2302-4e4d-986b-b1ee9819a7bc admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030331 Jun 03 15:19:25.411441 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 18/35] 10.222.0.93 () {64 vars in 1332 bytes} [Fri Jun 3 15:19:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:19:51.400870 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-cd558ec8-b424-4b99-ac17-9527d020c51b admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:51.401878 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-cd558ec8-b424-4b99-ac17-9527d020c51b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 03 15:19:51.402281 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 18/36] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:51.413888 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG dbcounter [-] [103179] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:19:51.461416 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-602f13c7-e6ff-47e7-889b-b29cdd37d46b admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:51.479238 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-602f13c7-e6ff-47e7-889b-b29cdd37d46b admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069829 Jun 03 15:19:51.479788 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 19/37] 10.222.0.93 () {60 vars in 1291 bytes} [Fri Jun 3 15:19:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:19:52.509760 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-cd558ec8-b424-4b99-ac17-9527d020c51b admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:52.510842 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-cd558ec8-b424-4b99-ac17-9527d020c51b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 03 15:19:52.511255 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 19/38] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:52.730015 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c3d2c83f-f8a9-44c4-a0b5-7686bc6faa81 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:52.736308 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.wsgi [None req-c3d2c83f-f8a9-44c4-a0b5-7686bc6faa81 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c3d2c83f-f8a9-44c4-a0b5-7686bc6faa81 admin admin] Request method failure captured: Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Accept: application/json Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Accept-Encoding: gzip, deflate Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Connection: keep-alive Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Content-Length: 0 Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Host: 10.222.0.93 Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Openstack-Api-Version: compute 2.90 Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Openstack-System-Scope: None Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: User-Agent: python-novaclient Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Auth-Token: gAAAAABimiaY9bGwcexBedWTxPKXN_Lrsf1GkmSfn2SdVWnIeYTl1hBoVbFFm5zUJHlg3WUgAZZXGwYCw8GMFXIt0JInavOrzoAQ7YctsUxFCOGEoDsY5FgbBrQSg_HDrJ1vhJ0DFEI_jYENH9IXyHKTAJdp7CA_QtOuKHzBraiBI1vD1D3hRrE Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Domain-Id: None Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Domain-Name: None Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Identity-Status: Confirmed Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Is-Admin-Project: True Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Domain-Id: default Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Domain-Name: Default Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Name: admin Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Role: reader,admin,member Jun 03 15:19:52.739631 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Roles: reader,admin,member Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4b7e9c80374f4695bdf655157e8cb4d3"}]}] Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Tenant: admin Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Tenant-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Tenant-Name: admin Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User: admin Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Domain-Id: default Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Domain-Name: Default Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Id: b868f066d8ff4579b72df10988c4ede1 Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Name: admin Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: method: > Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: exception: Flavor 42 could not be found. Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: action_args: {'id': '42'} Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:19:52.741140 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:52.741998 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:52.743224 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c3d2c83f-f8a9-44c4-a0b5-7686bc6faa81 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:19:52.744291 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c3d2c83f-f8a9-44c4-a0b5-7686bc6faa81 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065470 Jun 03 15:19:52.744291 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 20/39] 10.222.0.93 () {60 vars in 1190 bytes} [Fri Jun 3 15:19:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 15:19:52.751514 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-ad975eec-db31-4a89-b14c-b00aa88973bf admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:52.754436 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:19:52.776781 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-ad975eec-db31-4a89-b14c-b00aa88973bf admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028877 Jun 03 15:19:52.777368 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 20/40] 10.222.0.93 () {60 vars in 1210 bytes} [Fri Jun 3 15:19:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:19:52.793264 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-bfede2f4-11cc-496f-bff8-96d9aae97ad1 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:52.815553 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-bfede2f4-11cc-496f-bff8-96d9aae97ad1 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025863 Jun 03 15:19:52.816116 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 21/41] 10.222.0.93 () {60 vars in 1210 bytes} [Fri Jun 3 15:19:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:19:52.825762 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-64fecbd5-5aae-4913-856c-b13b0c3f813d admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:52.834062 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.wsgi [None req-64fecbd5-5aae-4913-856c-b13b0c3f813d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-64fecbd5-5aae-4913-856c-b13b0c3f813d admin admin] Request method failure captured: Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Accept: application/json Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Accept-Encoding: gzip, deflate Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Connection: keep-alive Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Content-Length: 0 Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Host: 10.222.0.93 Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Openstack-Api-Version: compute 2.90 Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Openstack-System-Scope: None Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: User-Agent: python-novaclient Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Auth-Token: gAAAAABimiaY9bGwcexBedWTxPKXN_Lrsf1GkmSfn2SdVWnIeYTl1hBoVbFFm5zUJHlg3WUgAZZXGwYCw8GMFXIt0JInavOrzoAQ7YctsUxFCOGEoDsY5FgbBrQSg_HDrJ1vhJ0DFEI_jYENH9IXyHKTAJdp7CA_QtOuKHzBraiBI1vD1D3hRrE Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Domain-Id: None Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Domain-Name: None Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Identity-Status: Confirmed Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Is-Admin-Project: True Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Domain-Id: default Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Domain-Name: Default Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Name: admin Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Role: reader,admin,member Jun 03 15:19:52.837713 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Roles: reader,admin,member Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4b7e9c80374f4695bdf655157e8cb4d3"}]}] Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Tenant: admin Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Tenant-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Tenant-Name: admin Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User: admin Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Domain-Id: default Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Domain-Name: Default Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Id: b868f066d8ff4579b72df10988c4ede1 Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Name: admin Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: method: > Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: exception: Flavor 42 could not be found. Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: action_args: {'id': '42'} Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:19:52.839070 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:52.839902 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:52.841133 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-64fecbd5-5aae-4913-856c-b13b0c3f813d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:19:52.843021 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-64fecbd5-5aae-4913-856c-b13b0c3f813d admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017096 Jun 03 15:19:52.843021 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 21/42] 10.222.0.93 () {60 vars in 1190 bytes} [Fri Jun 3 15:19:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 15:19:53.728422 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-bfede2f4-11cc-496f-bff8-96d9aae97ad1 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:53.729441 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-bfede2f4-11cc-496f-bff8-96d9aae97ad1 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 03 15:19:53.729837 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 22/43] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:19:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:53.925470 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-e8677a5b-a136-4270-bb5d-072582a50a56 admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:53.930879 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.wsgi [None req-e8677a5b-a136-4270-bb5d-072582a50a56 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-e8677a5b-a136-4270-bb5d-072582a50a56 admin admin] Request method failure captured: Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Accept: application/json Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Accept-Encoding: gzip, deflate Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Connection: keep-alive Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Content-Length: 0 Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Host: 10.222.0.93 Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Openstack-Api-Version: compute 2.90 Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Openstack-System-Scope: None Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: User-Agent: python-novaclient Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Auth-Token: gAAAAABimiaZjs4u2uoxIbnFsLuLaw97p54KEhxXPyHDejLFlqQtusGIx2_u8DefedQ-jCWsEvpP7k8w35J8emRWN5F_cATW4hlcjgCTciU7RkbWu_goo94PiksDrJOAKTUnSK3K11GOgOtCr7RGZacU-mibnw8UT0qd4oS0-UJN0milkB3ECi0 Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Domain-Id: None Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Domain-Name: None Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Identity-Status: Confirmed Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Is-Admin-Project: True Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Domain-Id: default Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Domain-Name: Default Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Name: admin Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Role: reader,admin,member Jun 03 15:19:53.932495 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Roles: reader,admin,member Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4b7e9c80374f4695bdf655157e8cb4d3"}]}] Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Tenant: admin Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Tenant-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Tenant-Name: admin Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User: admin Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Domain-Id: default Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Domain-Name: Default Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Id: b868f066d8ff4579b72df10988c4ede1 Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Name: admin Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: method: > Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: exception: Flavor 84 could not be found. Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: action_args: {'id': '84'} Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:19:53.933995 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:53.935006 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:53.936780 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-e8677a5b-a136-4270-bb5d-072582a50a56 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:19:53.937998 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-e8677a5b-a136-4270-bb5d-072582a50a56 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068147 Jun 03 15:19:53.937998 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 22/44] 10.222.0.93 () {60 vars in 1190 bytes} [Fri Jun 3 15:19:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 15:19:53.944461 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-b95759e8-2c15-4ac5-a5cc-528e0428b9f0 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:53.958576 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-b95759e8-2c15-4ac5-a5cc-528e0428b9f0 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017672 Jun 03 15:19:53.959127 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 23/45] 10.222.0.93 () {60 vars in 1210 bytes} [Fri Jun 3 15:19:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:19:53.968392 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-e89a1ce7-62d8-4bbd-9239-5d98f7319a50 admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:53.981874 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-e89a1ce7-62d8-4bbd-9239-5d98f7319a50 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017004 Jun 03 15:19:53.982408 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 23/46] 10.222.0.93 () {60 vars in 1210 bytes} [Fri Jun 3 15:19:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:19:53.991593 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-af707071-3f08-409b-ade2-503598166c82 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:53.996903 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.wsgi [None req-af707071-3f08-409b-ade2-503598166c82 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-af707071-3f08-409b-ade2-503598166c82 admin admin] Request method failure captured: Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Accept: application/json Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Accept-Encoding: gzip, deflate Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Connection: keep-alive Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Content-Length: 0 Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Host: 10.222.0.93 Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Openstack-Api-Version: compute 2.90 Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Openstack-System-Scope: None Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: User-Agent: python-novaclient Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Auth-Token: gAAAAABimiaZjs4u2uoxIbnFsLuLaw97p54KEhxXPyHDejLFlqQtusGIx2_u8DefedQ-jCWsEvpP7k8w35J8emRWN5F_cATW4hlcjgCTciU7RkbWu_goo94PiksDrJOAKTUnSK3K11GOgOtCr7RGZacU-mibnw8UT0qd4oS0-UJN0milkB3ECi0 Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Domain-Id: None Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Domain-Name: None Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Identity-Status: Confirmed Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Is-Admin-Project: True Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Domain-Id: default Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Domain-Name: Default Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Name: admin Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Role: reader,admin,member Jun 03 15:19:53.999234 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Roles: reader,admin,member Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4b7e9c80374f4695bdf655157e8cb4d3"}]}] Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Tenant: admin Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Tenant-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Tenant-Name: admin Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User: admin Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Domain-Id: default Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Domain-Name: Default Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Id: b868f066d8ff4579b72df10988c4ede1 Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Name: admin Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: method: > Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: exception: Flavor 84 could not be found. Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: action_args: {'id': '84'} Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:19:54.000727 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:54.001679 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:54.002993 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-af707071-3f08-409b-ade2-503598166c82 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:19:54.004351 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-af707071-3f08-409b-ade2-503598166c82 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012531 Jun 03 15:19:54.004351 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 24/47] 10.222.0.93 () {60 vars in 1190 bytes} [Fri Jun 3 15:19:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 15:19:54.899635 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-e89a1ce7-62d8-4bbd-9239-5d98f7319a50 admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:54.900640 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-e89a1ce7-62d8-4bbd-9239-5d98f7319a50 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 03 15:19:54.901177 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 24/48] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:55.089237 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c67c7271-a496-40b1-870c-5e18625329c9 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:55.095619 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.wsgi [None req-c67c7271-a496-40b1-870c-5e18625329c9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c67c7271-a496-40b1-870c-5e18625329c9 admin admin] Request method failure captured: Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Accept: application/json Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Accept-Encoding: gzip, deflate Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Connection: keep-alive Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Content-Length: 0 Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Host: 10.222.0.93 Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Openstack-Api-Version: compute 2.90 Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Openstack-System-Scope: None Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: User-Agent: python-novaclient Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Auth-Token: gAAAAABimiaaIZjhdvPMtmkE2SYR255XUdzO2A3-4MpoQOZw1VWne9euXiQfJ1IEIVV5EqGR-JqSSdrz7PeZk5UVouE2lMa_19ILIlBm685UsGF4qrfKidisXWLfRiZlhuNxqp41EbpjOBwEwsV8FKkoqp_153PRu7r4-hMeUrgrAzF7N1VU_pc Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Domain-Id: None Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Domain-Name: None Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Identity-Status: Confirmed Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Is-Admin-Project: True Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Domain-Id: default Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Domain-Name: Default Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Project-Name: admin Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Role: reader,admin,member Jun 03 15:19:55.097318 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Roles: reader,admin,member Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4b7e9c80374f4695bdf655157e8cb4d3"}]}] Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Tenant: admin Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Tenant-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-Tenant-Name: admin Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User: admin Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Domain-Id: default Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Domain-Name: Default Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Id: b868f066d8ff4579b72df10988c4ede1 Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: X-User-Name: admin Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: method: > Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: exception: Flavor 451 could not be found. Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: action_args: {'id': '451'} Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:19:55.099009 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:55.100113 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: ERROR nova.api.openstack.wsgi Jun 03 15:19:55.101524 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c67c7271-a496-40b1-870c-5e18625329c9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:19:55.102806 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c67c7271-a496-40b1-870c-5e18625329c9 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060235 Jun 03 15:19:55.102806 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 25/49] 10.222.0.93 () {60 vars in 1193 bytes} [Fri Jun 3 15:19:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 15:19:55.108471 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-f6e621b1-f553-4f7f-bf27-22a270bb7e0e admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:55.121856 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-f6e621b1-f553-4f7f-bf27-22a270bb7e0e admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016955 Jun 03 15:19:55.122386 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 25/50] 10.222.0.93 () {60 vars in 1210 bytes} [Fri Jun 3 15:19:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:19:55.131874 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:55.146059 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017725 Jun 03 15:19:55.146632 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 26/51] 10.222.0.93 () {60 vars in 1210 bytes} [Fri Jun 3 15:19:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:19:55.156894 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-ed4eb4fe-827e-44d5-9e6c-b5d68c367890 admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:55.162377 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.wsgi [None req-ed4eb4fe-827e-44d5-9e6c-b5d68c367890 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-ed4eb4fe-827e-44d5-9e6c-b5d68c367890 admin admin] Request method failure captured: Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Accept: application/json Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Accept-Encoding: gzip, deflate Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Connection: keep-alive Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Content-Length: 0 Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Host: 10.222.0.93 Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Openstack-Api-Version: compute 2.90 Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Openstack-System-Scope: None Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: User-Agent: python-novaclient Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Auth-Token: gAAAAABimiaaIZjhdvPMtmkE2SYR255XUdzO2A3-4MpoQOZw1VWne9euXiQfJ1IEIVV5EqGR-JqSSdrz7PeZk5UVouE2lMa_19ILIlBm685UsGF4qrfKidisXWLfRiZlhuNxqp41EbpjOBwEwsV8FKkoqp_153PRu7r4-hMeUrgrAzF7N1VU_pc Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Domain-Id: None Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Domain-Name: None Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Identity-Status: Confirmed Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Is-Admin-Project: True Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Domain-Id: default Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Domain-Name: Default Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Project-Name: admin Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Role: reader,admin,member Jun 03 15:19:55.163882 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Roles: reader,admin,member Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4b7e9c80374f4695bdf655157e8cb4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4b7e9c80374f4695bdf655157e8cb4d3"}]}] Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Tenant: admin Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Tenant-Id: 4b7e9c80374f4695bdf655157e8cb4d3 Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-Tenant-Name: admin Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User: admin Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Domain-Id: default Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Domain-Name: Default Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Id: b868f066d8ff4579b72df10988c4ede1 Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: X-User-Name: admin Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: method: > Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: exception: Flavor 451 could not be found. Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: action_args: {'id': '451'} Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:19:55.165500 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:55.166345 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: ERROR nova.api.openstack.wsgi Jun 03 15:19:55.167573 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-ed4eb4fe-827e-44d5-9e6c-b5d68c367890 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:19:55.168960 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-ed4eb4fe-827e-44d5-9e6c-b5d68c367890 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012830 Jun 03 15:19:55.168960 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 26/52] 10.222.0.93 () {60 vars in 1193 bytes} [Fri Jun 3 15:19:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 15:19:56.038266 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:56.039310 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 03 15:19:56.039709 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 27/53] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:19:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:56.229201 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-308b6888-1038-464a-b8c0-21d135198cea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:56.247941 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-308b6888-1038-464a-b8c0-21d135198cea admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070571 Jun 03 15:19:56.248412 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 27/54] 10.222.0.93 () {64 vars in 1235 bytes} [Fri Jun 3 15:19:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:19:57.133507 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:57.134509 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 03 15:19:57.134927 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 28/55] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:57.334980 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-d6cf88c5-52a7-4526-9133-680ab50b3f5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:57.353329 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-d6cf88c5-52a7-4526-9133-680ab50b3f5a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073472 Jun 03 15:19:57.353817 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 28/56] 10.222.0.93 () {64 vars in 1235 bytes} [Fri Jun 3 15:19:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:19:58.237570 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:58.238648 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 03 15:19:58.239077 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 29/57] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:19:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:58.429110 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-88f0a857-c2dc-4eeb-a124-e77b293d3e3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:58.446851 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-88f0a857-c2dc-4eeb-a124-e77b293d3e3a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068495 Jun 03 15:19:58.447337 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 29/58] 10.222.0.93 () {64 vars in 1235 bytes} [Fri Jun 3 15:19:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:19:59.311587 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:19:59.312593 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 03 15:19:59.312985 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 30/59] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:19:59.501426 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-39897fa6-0d39-497e-8033-9bc234c172c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:19:59.519402 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-39897fa6-0d39-497e-8033-9bc234c172c0 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069788 Jun 03 15:19:59.519877 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 30/60] 10.222.0.93 () {64 vars in 1235 bytes} [Fri Jun 3 15:19:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:20:00.395363 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:20:00.396364 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 03 15:20:00.396752 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 31/61] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:20:00.589600 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-7ec3aa58-19d5-4c7e-abb3-88f98dd904fe admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:20:00.609746 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-7ec3aa58-19d5-4c7e-abb3-88f98dd904fe admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074719 Jun 03 15:20:00.610192 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 31/62] 10.222.0.93 () {60 vars in 1202 bytes} [Fri Jun 3 15:20:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:21:02.223276 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:21:02.224294 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-c388c9e3-ea7d-4b7b-b448-8115943cb19b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 03 15:21:02.224705 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 32/63] 10.222.0.93 () {54 vars in 930 bytes} [Fri Jun 3 15:21:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:21:02.232703 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:21:02.289764 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-7eb4ca65-3413-4452-946a-cc7bb5a0e366 admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:21:02.310513 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-7eb4ca65-3413-4452-946a-cc7bb5a0e366 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079131 Jun 03 15:21:02.311131 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 32/64] 10.222.0.93 () {60 vars in 1291 bytes} [Fri Jun 3 15:21:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:21:02.332713 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG dbcounter [-] [103179] Writing DB stats nova_api:SELECT=14 {{(pid=103179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:21:02.336721 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-a836a722-8e1c-4ed0-936f-d2918cbaa93f admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:21:02.344761 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-a836a722-8e1c-4ed0-936f-d2918cbaa93f admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013562 Jun 03 15:21:02.345336 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 33/65] 10.222.0.93 () {60 vars in 1282 bytes} [Fri Jun 3 15:21:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:21:02.357434 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-72746b73-8a6a-438b-b7fc-3febfa7c09ef admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:21:02.365291 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-72746b73-8a6a-438b-b7fc-3febfa7c09ef admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011525 Jun 03 15:21:02.365863 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 33/66] 10.222.0.93 () {60 vars in 1285 bytes} [Fri Jun 3 15:21:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:21:02.378044 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-9867b3a0-322e-4306-b809-51d4f588ad75 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:21:02.385704 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-9867b3a0-322e-4306-b809-51d4f588ad75 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011314 Jun 03 15:21:02.386227 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 34/67] 10.222.0.93 () {60 vars in 1285 bytes} [Fri Jun 3 15:21:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:21:02.398419 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-7c1cc581-0ded-4982-b400-5d6042a422aa admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:21:02.406469 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-7c1cc581-0ded-4982-b400-5d6042a422aa admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011313 Jun 03 15:21:02.406957 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 34/68] 10.222.0.93 () {60 vars in 1282 bytes} [Fri Jun 3 15:21:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:24:30.542626 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-9867b3a0-322e-4306-b809-51d4f588ad75 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:24:30.543641 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-9867b3a0-322e-4306-b809-51d4f588ad75 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 03 15:24:30.544034 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 35/69] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:24:30.701703 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writing DB stats nova_api:SELECT=6 {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:24:30.815788 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-c2aa749e-b41d-4bbc-887b-d6d797b95c3b admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:24:30.816943 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 15:24:30.816943 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: warnings.warn(msg) Jun 03 15:24:30.818174 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-c2aa749e-b41d-4bbc-887b-d6d797b95c3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:24:30.818637 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-c2aa749e-b41d-4bbc-887b-d6d797b95c3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:24:30.819421 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-c2aa749e-b41d-4bbc-887b-d6d797b95c3b admin admin] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:24:30.819844 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-c2aa749e-b41d-4bbc-887b-d6d797b95c3b admin admin] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:24:30.853678 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-c2aa749e-b41d-4bbc-887b-d6d797b95c3b admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153411 Jun 03 15:24:30.854227 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 35/70] 10.222.0.93 () {60 vars in 1193 bytes} [Fri Jun 3 15:24:30 2022] GET /compute/v2.1/os-services => generated 794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:24:31.746750 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-9867b3a0-322e-4306-b809-51d4f588ad75 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:24:31.747753 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-9867b3a0-322e-4306-b809-51d4f588ad75 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 03 15:24:31.748149 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 36/71] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:24:31.942170 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-1a9a1769-ff04-4017-8259-d5d60d7c9b7a admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:24:31.943394 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 15:24:31.943394 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: warnings.warn(msg) Jun 03 15:24:31.944598 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-1a9a1769-ff04-4017-8259-d5d60d7c9b7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:24:31.945040 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-1a9a1769-ff04-4017-8259-d5d60d7c9b7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:24:31.945828 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-1a9a1769-ff04-4017-8259-d5d60d7c9b7a admin admin] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:24:31.946284 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-1a9a1769-ff04-4017-8259-d5d60d7c9b7a admin admin] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:24:31.968244 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-1a9a1769-ff04-4017-8259-d5d60d7c9b7a admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078013 Jun 03 15:24:31.968814 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 36/72] 10.222.0.93 () {60 vars in 1193 bytes} [Fri Jun 3 15:24:31 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:24:43.225640 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-9867b3a0-322e-4306-b809-51d4f588ad75 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:24:43.226668 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-9867b3a0-322e-4306-b809-51d4f588ad75 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 03 15:24:43.227070 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 37/73] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:24:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:24:43.368988 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writing DB stats nova_cell0:SELECT=4 {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:24:43.369685 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writing DB stats nova_cell1:SELECT=4 {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:24:43.370309 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG dbcounter [-] [103180] Writing DB stats nova_api:SELECT=8 {{(pid=103180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:24:43.418115 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-67d89e34-96c5-4ffd-9d83-ecda551aca22 admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:24:43.419333 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 15:24:43.419333 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: warnings.warn(msg) Jun 03 15:24:43.420518 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-67d89e34-96c5-4ffd-9d83-ecda551aca22 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:24:43.420958 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-67d89e34-96c5-4ffd-9d83-ecda551aca22 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:24:43.421739 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-67d89e34-96c5-4ffd-9d83-ecda551aca22 admin admin] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:24:43.422167 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-67d89e34-96c5-4ffd-9d83-ecda551aca22 admin admin] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:24:43.446737 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-67d89e34-96c5-4ffd-9d83-ecda551aca22 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.082071 Jun 03 15:24:43.447218 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 37/74] 10.222.0.93 () {60 vars in 1193 bytes} [Fri Jun 3 15:24:43 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:24:44.319853 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: DEBUG nova.api.openstack.wsgi [None req-9867b3a0-322e-4306-b809-51d4f588ad75 admin admin] Calling method '>' {{(pid=103179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:24:44.320866 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: INFO nova.api.openstack.requestlog [None req-9867b3a0-322e-4306-b809-51d4f588ad75 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 03 15:24:44.321268 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: [pid: 103179|app: 0|req: 38/75] 10.222.0.93 () {56 vars in 1074 bytes} [Fri Jun 3 15:24:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:24:44.512538 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG nova.api.openstack.wsgi [None req-274cce90-5376-437c-99fd-36cffa361257 admin admin] Calling method '>' {{(pid=103180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:24:44.513727 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 15:24:44.513727 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: warnings.warn(msg) Jun 03 15:24:44.515154 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-274cce90-5376-437c-99fd-36cffa361257 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:24:44.515595 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-274cce90-5376-437c-99fd-36cffa361257 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:24:44.516402 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-274cce90-5376-437c-99fd-36cffa361257 admin admin] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:24:44.516855 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: DEBUG oslo_concurrency.lockutils [None req-274cce90-5376-437c-99fd-36cffa361257 admin admin] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:24:44.538210 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: INFO nova.api.openstack.requestlog [None req-274cce90-5376-437c-99fd-36cffa361257 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078440 Jun 03 15:24:44.538742 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: [pid: 103180|app: 0|req: 38/76] 10.222.0.93 () {60 vars in 1193 bytes} [Fri Jun 3 15:24:44 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:25:44.612531 dv-cinder-831247-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 03 15:25:44.613432 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: Fri Jun 3 15:25:44 2022 - graceful shutdown triggered... Jun 03 15:25:44.613948 dv-cinder-831247-16-iscsi devstack@n-api.service[103179]: Gracefully killing worker 1 (pid: 103179)... Jun 03 15:25:44.614367 dv-cinder-831247-16-iscsi devstack@n-api.service[103180]: Gracefully killing worker 2 (pid: 103180)... Jun 03 15:25:45.614577 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: worker 1 buried after 1 seconds Jun 03 15:25:45.614577 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: worker 2 buried after 1 seconds Jun 03 15:25:45.614577 dv-cinder-831247-16-iscsi devstack@n-api.service[103176]: goodbye to uWSGI. Jun 03 15:25:45.616159 dv-cinder-831247-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 03 15:25:45.616712 dv-cinder-831247-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 03 15:25:45.619375 dv-cinder-831247-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 15:25:45.633756 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 15:25:45 2022] *** Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: nodename: dv-cinder-831247-16-iscsi Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: machine: x86_64 Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: clock source: unix Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: pcre jit disabled Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: detected number of CPU cores: 4 Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: current working directory: / Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: detected binary path: /usr/bin/uwsgi-core Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: your processes number limit is 47680 Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: your memory page size is 4096 bytes Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: detected max file descriptor number: 2048 Jun 03 15:25:45.646707 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: lock engine: pthread robust mutexes Jun 03 15:25:45.647858 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: thunder lock: enabled Jun 03 15:25:45.647858 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 15:25:45.647858 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 15:25:45.694790 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: Python main interpreter initialized at 0x563e56a0e9c0 Jun 03 15:25:45.694790 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: python threads support enabled Jun 03 15:25:45.694790 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: your server socket listen backlog is limited to 100 connections Jun 03 15:25:45.694790 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: your mercy for graceful operations on workers is 90 seconds Jun 03 15:25:45.695276 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 15:25:45.695276 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: *** Operational MODE: preforking *** Jun 03 15:25:45.695425 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: *** uWSGI is running in multiple interpreter mode *** Jun 03 15:25:45.695425 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: spawned uWSGI master process (pid: 117790) Jun 03 15:25:45.695621 dv-cinder-831247-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 15:25:45.696492 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: spawned uWSGI worker 1 (pid: 117805, cores: 1) Jun 03 15:25:45.696612 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: spawned uWSGI worker 2 (pid: 117806, cores: 1) Jun 03 15:25:45.696706 dv-cinder-831247-16-iscsi devstack@n-api.service[117790]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 15:25:46.939038 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 15:25:46.939653 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 15:25:47.773888 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 15:25:47.773888 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: from cryptography.utils import int_from_bytes Jun 03 15:25:47.774200 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 15:25:47.774200 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: from cryptography.utils import int_from_bytes Jun 03 15:25:47.776473 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 15:25:47.776473 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: from cryptography.utils import int_from_bytes Jun 03 15:25:47.776813 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 15:25:47.776813 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: from cryptography.utils import int_from_bytes Jun 03 15:25:50.201677 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 15:25:50.202288 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 15:25:50.202594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 15:25:50.202845 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 15:25:50.203018 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 15:25:50.203427 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 15:25:50.203522 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 15:25:50.203625 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.203764 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 15:25:50.203925 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.204105 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.204202 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 15:25:50.204363 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 15:25:50.204468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.204819 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.205027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.205118 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.205203 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.205360 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.205474 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.205676 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.205767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.206000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.206092 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.206262 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.206362 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.206606 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.206721 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.206936 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-16-iscsi {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.207064 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.207275 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.207391 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.207523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.207651 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.207834 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.207940 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.208155 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-16-iscsi {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.208261 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.208455 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.208554 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.208764 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.208866 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.209065 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.209163 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.209375 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.209556 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.209673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.210710 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.210814 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.210889 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.210961 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.210961 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.211119 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.211215 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.211290 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.211368 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.211446 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.211525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.211740 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.211841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.211994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.212142 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.212300 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.212449 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.212606 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.212760 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.212922 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.213163 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-16-iscsi {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.213284 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.213484 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.213596 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.213795 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.213911 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.214126 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.214279 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-16-iscsi {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.214618 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.214793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.214929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.215072 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.215217 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.215349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.215571 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.215700 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.215880 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.216018 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.216194 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.216537 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.216736 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.216867 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.217037 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.217148 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.217466 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.217637 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.217825 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.217922 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.218123 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.218234 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.218379 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.218481 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.218732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.218830 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.219017 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.219126 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.219322 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.219420 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.220697 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.220812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.220904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221007 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221094 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221190 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221283 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221395 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221497 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221628 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221723 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221809 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221897 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.221981 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.222078 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.222171 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.222256 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.222341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.222424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.222624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.223746 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.224076 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.224076 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.224255 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.224380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.224573 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.224670 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.224758 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.224851 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.224945 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225045 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225136 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225222 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225397 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225491 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225590 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225683 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225769 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225852 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.225944 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.226036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.226135 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.226228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.226313 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.226313 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.226468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.226568 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.227526 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.227638 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.227737 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.227823 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.227908 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228008 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228094 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228271 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228462 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228560 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228646 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228736 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228831 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.228926 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.229017 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.229225 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.229336 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.229540 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.229634 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.230395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.230500 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.230735 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.230837 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.231028 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.231120 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.231333 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.231425 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.231639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.231738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.231954 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.232052 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.232208 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.232349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.232552 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.232662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.232858 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.232971 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.233153 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.233348 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.233462 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.233658 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.233785 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.233962 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.234063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.234267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.234361 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.234585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.234694 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.234891 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.234983 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.235194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.235295 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.235498 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.235590 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.235801 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.235902 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.236104 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.236196 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.236406 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.236500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.236708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.236823 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.237012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.237124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.237311 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.237412 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.237612 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.237724 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.237923 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.238015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.238226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.238329 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.238543 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.238637 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.238852 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.238951 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.239156 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.239259 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.239457 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.239561 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.239760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.239850 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.240082 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.240177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.240357 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.240458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.240656 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.240756 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.241130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.241217 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.241317 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.241411 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.241552 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.241652 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.241853 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.241949 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.242157 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.242259 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.242449 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.242605 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.242781 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.242891 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.243084 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.243176 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.243389 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.243489 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.243689 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.243824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.243987 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.244080 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.244283 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.244380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.244581 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.244672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.244885 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.244979 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.245187 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.245365 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.245504 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.246341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.246499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.246656 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.246844 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.246972 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.247189 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.247322 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.247465 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.247584 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.247775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.247904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.248082 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.248211 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.248411 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 15:25:50.248543 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.248736 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.248864 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.249068 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.249190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.249399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.249524 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.249711 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.249835 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.250035 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.250257 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.250377 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.250496 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.250811 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.250924 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.258651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.258765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.258845 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.258920 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259100 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259182 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259262 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259421 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259508 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259591 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259664 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259745 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259825 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.259904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260003 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260080 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260160 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260314 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260486 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260557 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260711 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260789 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.260943 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261022 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261103 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261215 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261296 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261448 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261528 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261636 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261831 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.261944 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262110 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262284 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262463 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262551 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262648 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262730 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262809 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262881 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.262952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263106 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263185 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263420 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263493 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263574 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263655 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263728 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263798 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263879 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.263986 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264078 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264150 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264227 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264307 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264444 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264554 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264637 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264718 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264884 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.264957 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265042 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265123 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265203 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265283 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265356 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265434 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265515 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265669 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265750 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265825 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265896 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.265981 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.266063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.266135 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.266135 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.266271 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.266271 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.266429 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.266506 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.268929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.269105 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.269268 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.269436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.269597 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.269753 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.269902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.270058 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.270214 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.270371 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.270517 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.270700 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.270857 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.271010 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.271623 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.271799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.271949 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.272095 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.272252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.272252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.272555 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.272712 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.272859 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.272859 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.273164 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.273164 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.273469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.273469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.273752 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.273752 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.274034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.274181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.274345 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.274345 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.274661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.274661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.274954 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.275116 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.275524 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.275673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.275818 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.275971 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.276124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.276280 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.276426 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.276579 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.276725 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.276920 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.277124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.277926 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.278105 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.278300 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.279134 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.279295 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.279458 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.279618 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.279765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.279910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.280062 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.280215 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.280362 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.280516 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.280673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.280838 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.280985 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.281137 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.281298 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.281456 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.281602 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.281756 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.281902 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.282048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.282272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.282428 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.282640 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.282815 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.282970 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.283123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.283123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.283418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.283564 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.283710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.283710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.283996 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.284155 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.284309 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.284309 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.284599 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.284757 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.284916 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.285062 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.285215 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.285368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.285514 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.285665 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.285822 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.285975 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.286128 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.286273 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.286425 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.286600 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.286771 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.286919 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.287064 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.287209 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.287359 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.287504 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.287659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.287811 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.287966 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.288119 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.288264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.288419 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.288671 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.289414 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.289572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.289726 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.289872 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.290035 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.290183 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.290338 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.290484 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.290667 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.291297 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.291473 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.291629 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.291782 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.291950 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.292106 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.292305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.292993 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.293153 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.293306 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.293457 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.293609 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.293761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.293933 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.294087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.294248 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.294419 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.294632 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.294807 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.294960 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.295119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.295282 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.295441 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.295639 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.295816 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.295978 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.296131 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.296284 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.296443 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.296607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.296775 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.296928 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.297088 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.297241 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.297394 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.297555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.297729 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.297891 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.298044 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.298203 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.298364 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.298545 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.298825 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.299572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.299738 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.299891 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.300042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.300204 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.300358 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.300512 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.300672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.300824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.300976 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.301140 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.301292 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.301454 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.301607 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.301766 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.301927 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.302090 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.302243 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.302395 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.302572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.302896 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.303105 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.303276 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.303430 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.303583 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.303583 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.303898 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.304060 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.304060 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.304358 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.304509 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.304509 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.304812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.305018 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.305184 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.305336 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.305487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.305649 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.305802 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.305963 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.306124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.306284 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.306437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.306626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.306801 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.306961 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.307122 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.307276 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.307427 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.307579 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.307756 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.307918 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.308115 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.308758 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.309155 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.309770 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.309942 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.310097 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.310399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.310599 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.310760 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.310913 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.311077 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.311285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.311449 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.311611 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.311765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.311918 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.312086 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.312240 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.312398 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.312551 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.312703 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.312865 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.313018 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.313170 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.313333 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.313494 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.313655 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.313832 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.313994 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.314149 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.314309 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.314462 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.314676 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.314843 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.314996 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.315157 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.315335 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.316033 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.316199 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.316444 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.316601 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.316753 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.316904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.317057 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.317219 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.317381 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.317381 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.317688 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.317839 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.318010 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.318172 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.318333 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.318493 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.318698 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.318863 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.319034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.319847 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.320024 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.320024 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.320325 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.320325 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.320627 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.320800 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.320960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.321113 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.321265 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.321432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.321601 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.321761 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.321914 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.322067 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.322226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.322378 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.322605 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.322787 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.323084 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.323277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.323277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.323583 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.323783 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.323959 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.324112 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.324264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.324415 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.324576 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.324738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.324905 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.325070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.325222 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.325375 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.325526 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.325725 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.325894 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.326049 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.326208 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.326361 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.326512 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.326704 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.326858 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.327019 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.327183 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.327336 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.327490 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.327662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.327824 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.327978 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.328139 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.328292 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.328451 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.328614 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.328766 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.328927 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.329080 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.329271 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.330072 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.330230 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.330391 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.330578 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.330738 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.330892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.331062 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.331223 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.331377 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.331538 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.331692 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.331863 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.332027 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.332181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.332396 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.332571 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.332726 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.332886 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.333051 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.333206 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.333366 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.333519 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.333671 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.333844 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.334018 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.334179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.334332 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.334485 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.334676 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.334845 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.335006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.335160 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.335311 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.335463 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.335622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.335786 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.335947 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.336110 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.336264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.336424 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.336577 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.336743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.336897 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.337057 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.337211 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.337364 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.337531 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.337702 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.337863 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.338016 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.338179 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.338341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.338509 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.338699 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.338854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.339015 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.339177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.339371 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.339371 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.340379 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.340543 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.340704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.340875 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.341047 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.341827 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.341997 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.342152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.342314 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.342477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.342694 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.342858 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.343012 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.343174 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.343327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.343490 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.343672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.343838 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.343999 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.344160 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.344313 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.344466 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.344629 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.344782 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.344935 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.345096 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.345249 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.345409 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.345572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.345753 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.346091 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.346261 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.346417 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.346605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.346773 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.346927 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.347087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.347249 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.347402 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.347564 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.347727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.347888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.348054 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.348207 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.348359 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.348523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.348676 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.348830 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.348991 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.349144 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.349297 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.349523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.350414 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.350652 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.350824 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.350999 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.351164 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.351318 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.351470 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.351775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.351950 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.352105 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.352268 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.352422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.352582 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.352735 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.352894 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.353059 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.353221 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.353474 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.353641 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.353805 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.353969 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.354123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.354285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.354448 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.354660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.354819 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.355554 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.355730 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.355896 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.356060 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.356212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.356364 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.356523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.356690 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.356843 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.357004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.357159 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.357319 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.357471 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.357636 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.357790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.357952 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.358145 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.358387 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.358646 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.358935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.359137 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.359295 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.359449 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.359609 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.359609 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.360626 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.360805 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.360970 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.361135 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.361290 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.361459 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.361624 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.361787 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.361787 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.362079 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.362239 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.362407 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.362622 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.362794 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.362948 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.363100 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.363263 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.363432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.363586 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.363745 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.363906 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.364066 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.364225 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.364399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.364555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.364715 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.364875 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.365028 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.365195 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.365363 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.365524 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.365678 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.365830 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.365983 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.366149 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.366304 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.366456 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.366644 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.366799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.366961 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.367129 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.367299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.367453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.367606 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.367757 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.367917 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.368084 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.368245 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.368398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.368551 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.368704 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.368866 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.369020 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.369173 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.369335 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.369495 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.369648 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.369812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.369966 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.371393 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.371561 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.371716 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.371878 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.372046 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.372209 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.372371 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.372524 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.372688 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.372841 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.373010 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.373173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.373334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.373497 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.373659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.373824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.373985 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.374137 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.374296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.374461 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.374650 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.374817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.374817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.375118 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.375273 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.375426 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.375586 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.375752 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.375914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.376067 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.376219 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.376372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.376531 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.376707 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.376860 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.377021 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.377021 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.377376 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.377545 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.377706 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.377859 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.378010 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.378170 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.378323 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.378488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.378714 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.378896 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.379059 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.379213 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.379372 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.379540 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.379694 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.379846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.379997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.380156 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.380741 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.380988 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.381157 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.381341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.381676 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.381829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.381997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.382152 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.382322 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.382485 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.382695 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.382861 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.383015 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.383175 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.383329 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.383483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.384702 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.384871 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.385045 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.385208 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.385369 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.385525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.385698 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.385861 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.386026 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.386211 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.386374 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.386599 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.386775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.386942 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.387103 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.387257 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.387417 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.387572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.387734 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.387895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.388048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.388202 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.388355 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.388518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.388672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.388672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.388970 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.389122 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.389274 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.389474 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.389631 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.389792 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.389956 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.390109 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.390269 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.390870 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.391123 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.391284 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.391449 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.391808 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.391978 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.392153 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.392316 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.392470 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.392622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.392775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.392937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.393130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.393284 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.393444 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.393605 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.393774 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.393942 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.394096 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.394256 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.394418 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.394590 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.394759 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.394936 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.395093 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.395236 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.395381 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.395470 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.395555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.395652 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.395747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.395835 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.395929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.396067 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.396197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.396312 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.396432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.396546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.396667 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.396794 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.396923 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.397044 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.397156 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.397275 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.397388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.397509 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.397631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.397743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.397856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.397975 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.398090 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.398201 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.398324 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.398437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.398583 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.398713 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.398845 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.398972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.399088 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.399207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.399320 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.399440 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.399553 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.399678 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.399801 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.399916 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.400028 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.400140 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.400505 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.401057 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.401275 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.401395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.401508 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.401620 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.402437 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.402610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.402769 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.402896 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.403012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.403208 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.403347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.403471 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.403584 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.403704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.403824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.403938 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.404061 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.404061 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.404275 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.404396 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.404509 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.404629 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.404755 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.404871 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.405043 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.405165 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.405277 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.405390 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.405517 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.405631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.405744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.405856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.405976 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.406100 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.406214 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.406326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.406326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.406572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.406724 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.406861 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.406976 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.407088 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.407201 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.407313 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.407426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.407553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.407675 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.407797 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.407917 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.408038 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.408158 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.408280 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.408401 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.408515 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.408515 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.408723 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.408723 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.408951 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.409079 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.409193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.409304 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.409416 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.409538 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.409651 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.409763 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.409882 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.409995 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.410116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.410256 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.410513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.410694 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.410694 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.411470 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.411590 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.411714 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.411829 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.411948 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.412062 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.412184 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.412402 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.412718 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.412847 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.412968 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.413082 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.413194 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.413320 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.413441 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.413441 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.413441 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.413441 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.413869 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.413984 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.414095 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.414218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.414330 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.414444 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.414635 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.414799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.414925 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.415041 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.415153 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.415279 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.415394 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.415505 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.415617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.415736 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.415851 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.415973 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.416097 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.416210 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.416321 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.416432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.416543 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.416663 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.416783 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.416897 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.417008 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.417119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.417239 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.417386 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.417545 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.418151 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.418263 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.418374 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.418500 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.418642 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.418778 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.418901 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.419015 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.419126 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.419250 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.419364 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.419484 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.419596 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.419596 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.419827 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.419948 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.420070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.420183 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.420295 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.420407 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.420533 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.420654 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.420776 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.420917 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.421467 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.421467 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.421779 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.421779 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.422009 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.422009 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.422220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.422340 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.422466 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.422660 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.422968 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.423200 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.423345 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.423471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.423586 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.423698 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.423809 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.423921 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.424040 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.424163 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.424285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.424406 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.424520 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.424632 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.424743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.424743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.424978 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.425091 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.425204 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.425323 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.425443 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.425570 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.425685 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.425804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.425926 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.426047 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.426169 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.426283 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.426396 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.426507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.426642 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.426642 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.426880 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.426995 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.427106 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.427225 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.427338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.427456 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.427577 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.427690 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.427802 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.427928 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.428050 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.428163 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.428284 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.428398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.428516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.428773 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.428896 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.429089 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.429220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.429341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.429464 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.429585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.429705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.429828 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.429942 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.430062 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.430176 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.430295 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.430408 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.430562 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.430696 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.430831 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.430970 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.431125 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.431666 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.431879 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.432014 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.432146 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.432277 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.432407 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.432548 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.432681 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.432811 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.433154 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.433301 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.433459 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.433602 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.433735 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.433866 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.434004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.434137 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.434275 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.434417 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.434572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.434708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.434838 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.434986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.435119 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.435264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.435396 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.435534 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.435665 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.435798 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.435942 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.436075 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.436196 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.436328 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.436466 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.436612 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.436753 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.436886 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.437024 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.437169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.437373 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.437515 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.437515 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.437857 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.437990 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.438127 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.438265 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.438403 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.438594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.438740 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.438880 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.439012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.439142 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.439281 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.439281 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.439538 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.439669 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.439799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.439929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.440073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.440204 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.440334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.440470 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.440615 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.440760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.440900 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.442163 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.442306 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.442440 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.442587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.442742 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.442884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.443018 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.443338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.443474 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.443614 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.443756 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.443896 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.444028 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.444160 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.444290 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.444420 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.444420 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.444686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.444825 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.444962 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.445092 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.445234 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.445374 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.445374 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.445628 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.445768 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.445768 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.446037 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.446177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.446310 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.446450 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.446651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.446785 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.446785 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.447050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.447188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.447188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.447438 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.448128 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.448266 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.448398 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.448398 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.448694 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.448837 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.448837 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.449092 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.449468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.449468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.449749 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.449888 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.450020 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.450158 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.450300 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.450433 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.450433 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.450712 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.450843 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.450843 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.451098 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.451238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.451238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.451505 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.451650 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.451650 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.452687 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.452831 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.452964 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.453102 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.453102 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.453626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.453774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.453914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.454054 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.454186 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.454350 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.454502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.454670 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.454814 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.454960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.454960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.455208 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.455349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.455481 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.455610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.455610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.455873 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.458552 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.458552 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.458839 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.458990 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.459134 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.459269 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.459269 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.459534 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.459666 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.459666 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.459936 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.460069 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.460069 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.460332 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.460463 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.460594 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.460952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.460952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.461226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.461369 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.461502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.461634 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.461765 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.461910 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.461910 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.462954 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.463102 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.463102 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.463269 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.463371 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.463460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.463560 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.463862 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.463964 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.463964 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.464140 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.464738 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.464738 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.464906 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465088 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465370 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465464 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465551 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465647 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465647 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465815 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465901 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.465994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466082 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466437 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466547 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466649 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466748 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466748 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466906 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.466999 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.467085 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.467171 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.467171 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.467350 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.467438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.467597 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.467704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.467874 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.467980 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468077 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468173 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468268 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468356 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468455 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468543 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468629 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468715 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468808 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468898 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.468993 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469082 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469082 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469249 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469342 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469438 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469527 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469527 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469692 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469786 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469786 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.469952 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470040 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470125 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470210 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470210 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470373 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470622 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470713 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.470994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471185 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471452 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471727 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471816 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 15:25:50.471902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.471902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.472767 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.472767 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.472767 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.472767 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.473231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.473614 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.474004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.474388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.474805 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.475201 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.475580 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.475972 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.476365 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.476781 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.477167 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.477579 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.477975 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.478373 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.478781 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.479157 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 15:25:50.479468 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 15:25:50.526775 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO dbcounter [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Registered counter for database nova_api Jun 03 15:25:50.541248 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO dbcounter [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Registered counter for database nova_api Jun 03 15:25:50.546787 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_db.sqlalchemy.engines [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117806) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:25:50.553381 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writer thread running {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:25:50.561315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_db.sqlalchemy.engines [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:25:50.568189 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writer thread running {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:25:50.612577 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.context [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d0d96d0-a575-4f71-9a90-c4114fd48e50(cell1) {{(pid=117806) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 15:25:50.616749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:25:50.618341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:25:50.619174 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:25:50.621668 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:25:50.623669 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO dbcounter [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Registered counter for database nova_cell0 Jun 03 15:25:50.627041 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.context [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d0d96d0-a575-4f71-9a90-c4114fd48e50(cell1) {{(pid=117805) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 15:25:50.627925 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO dbcounter [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Registered counter for database nova_cell1 Jun 03 15:25:50.631167 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:25:50.632773 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:25:50.633598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:25:50.636046 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_db.sqlalchemy.engines [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117806) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:25:50.636811 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:25:50.637914 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_db.sqlalchemy.engines [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117806) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:25:50.638354 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO dbcounter [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Registered counter for database nova_cell0 Jun 03 15:25:50.642445 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO dbcounter [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Registered counter for database nova_cell1 Jun 03 15:25:50.643604 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writer thread running {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:25:50.644985 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writer thread running {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:25:50.649850 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_db.sqlalchemy.engines [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:25:50.655050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writer thread running {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:25:50.655699 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_db.sqlalchemy.engines [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:25:50.794589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO dbcounter [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Registered counter for database nova_cell0 Jun 03 15:25:50.801301 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_db.sqlalchemy.engines [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117806) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:25:50.801932 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writer thread running {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:25:50.805645 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writer thread running {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:25:50.811546 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO dbcounter [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Registered counter for database nova_cell0 Jun 03 15:25:50.818230 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_db.sqlalchemy.engines [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 15:25:50.823352 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writer thread running {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 15:25:51.245612 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: WARNING keystonemiddleware.auth_token [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 15:25:51.253506 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: WARNING keystonemiddleware.auth_token [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 15:25:51.271210 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: WARNING keystonemiddleware.auth_token [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 15:25:51.279457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: WARNING keystonemiddleware.auth_token [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 15:25:51.483702 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: WARNING keystonemiddleware.auth_token [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 15:25:51.489842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: WARNING keystonemiddleware.auth_token [None req-8e696c84-03ed-4c25-9ac6-a9cfe363a5d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 15:25:51.495024 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563e56a0e9c0 pid: 117806 (default app) Jun 03 15:25:51.514178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: WARNING keystonemiddleware.auth_token [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 15:25:51.520896 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: WARNING keystonemiddleware.auth_token [None req-19f828e6-2bfc-4917-84f0-0b833762e9a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 15:25:51.527193 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563e56a0e9c0 pid: 117805 (default app) Jun 03 15:26:34.352331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=3 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:34.355266 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=3 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:34.359223 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=3 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:34.361403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=3 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:35.500969 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=3 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:35.503527 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=3 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:35.504505 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=3 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:35.508559 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=3 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:36.258706 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bb22d492-b7f8-4aa5-a807-ee65a746b8bd tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Action: 'create', calling method: .version_select at 0x7f92f2ce1310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2008367301", "metadata": {"Type": "work"}}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bb22d492-b7f8-4aa5-a807-ee65a746b8bd tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Request method failure captured: Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 122 Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigq2AKb0sd7fa_TSTH0Kk_YcEbbkccxLu8YXgGokzlBtYXILFionuiRR6a3jP7iZKdTuccS92cnrhWByE-bDlFbb_QavLQdTkODew-c0PXgm3PcoscRUbig3HlJyDbqTC3npvQ9-QYPuyjfqrDu7jimZnqDxureSZOllQjDARmvY9c Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:26:36.301610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b710b999eb884a96a85e9c6debe49306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b710b999eb884a96a85e9c6debe49306"}]}] Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 2e3ea44b40d9419aa51e0fa691d8dce9 Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2008367301", "metadata": {"Type": "work"}}} Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: Jun 03 15:26:36.303395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2008367301', 'metadata': {'Type': 'work'}}}} Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise error Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi '#$%' Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:26:36.304469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 15:26:36.306270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 15:26:36.307733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 15:26:36.307733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.307733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bb22d492-b7f8-4aa5-a807-ee65a746b8bd tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:26:36.307733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-bb22d492-b7f8-4aa5-a807-ee65a746b8bd tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.959013 Jun 03 15:26:36.307733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 1/1] 10.222.0.93 () {60 vars in 1155 bytes} [Fri Jun 3 15:26:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1962 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:26:36.320183 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d3a0e8ee-636b-47fa-b001-a7f6a74522f1 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Action: 'create', calling method: .version_select at 0x7f92f2b7b670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-166271481", "metadata": {"Type": "work"}}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d3a0e8ee-636b-47fa-b001-a7f6a74522f1 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Request method failure captured: Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 119 Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigq2AKb0sd7fa_TSTH0Kk_YcEbbkccxLu8YXgGokzlBtYXILFionuiRR6a3jP7iZKdTuccS92cnrhWByE-bDlFbb_QavLQdTkODew-c0PXgm3PcoscRUbig3HlJyDbqTC3npvQ9-QYPuyjfqrDu7jimZnqDxureSZOllQjDARmvY9c Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:26:36.325228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b710b999eb884a96a85e9c6debe49306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b710b999eb884a96a85e9c6debe49306"}]}] Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 2e3ea44b40d9419aa51e0fa691d8dce9 Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-166271481", "metadata": {"Type": "work"}}} Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: Jun 03 15:26:36.326884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-166271481', 'metadata': {'Type': 'work'}}}} Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise error Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi '0' Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:26:36.327660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 15:26:36.329116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 15:26:36.331800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 15:26:36.331800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.331800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d3a0e8ee-636b-47fa-b001-a7f6a74522f1 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:26:36.331800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d3a0e8ee-636b-47fa-b001-a7f6a74522f1 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017535 Jun 03 15:26:36.337236 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 2/2] 10.222.0.93 () {60 vars in 1155 bytes} [Fri Jun 3 15:26:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:26:36.349688 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-61959e26-80e3-4035-bd1f-b9bfe3368587 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Action: 'create', calling method: .version_select at 0x7f92f2ce1670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2139474881", "metadata": {"Type": "work"}}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-61959e26-80e3-4035-bd1f-b9bfe3368587 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Request method failure captured: Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 119 Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigq2AKb0sd7fa_TSTH0Kk_YcEbbkccxLu8YXgGokzlBtYXILFionuiRR6a3jP7iZKdTuccS92cnrhWByE-bDlFbb_QavLQdTkODew-c0PXgm3PcoscRUbig3HlJyDbqTC3npvQ9-QYPuyjfqrDu7jimZnqDxureSZOllQjDARmvY9c Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:26:36.352169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b710b999eb884a96a85e9c6debe49306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b710b999eb884a96a85e9c6debe49306"}]}] Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 2e3ea44b40d9419aa51e0fa691d8dce9 Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2139474881", "metadata": {"Type": "work"}}} Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: Jun 03 15:26:36.354146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2139474881', 'metadata': {'Type': 'work'}}}} Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise error Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi '' Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:26:36.354974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 15:26:36.357334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 15:26:36.358443 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 15:26:36.358443 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:36.358443 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-61959e26-80e3-4035-bd1f-b9bfe3368587 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:26:36.358443 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-61959e26-80e3-4035-bd1f-b9bfe3368587 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013210 Jun 03 15:26:36.362502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 3/3] 10.222.0.93 () {60 vars in 1155 bytes} [Fri Jun 3 15:26:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:26:36.373239 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a77cbc72-479e-4739-afb4-f1b8a5430f80 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Calling method '.version_select at 0x7f92f2b933a0>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:36.922712 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1163187499", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "networks": [{"uuid": "fa379d02-cec4-4bb7-8616-f922a2f53449"}]}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:26:37.303759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-a77cbc72-479e-4739-afb4-f1b8a5430f80 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] HTTP exception thrown: Volume tempest-invalid-1806967117 could not be found. Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a77cbc72-479e-4739-afb4-f1b8a5430f80 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Request method failure captured: Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1806967117 HTTP/1.1 Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigq2AKb0sd7fa_TSTH0Kk_YcEbbkccxLu8YXgGokzlBtYXILFionuiRR6a3jP7iZKdTuccS92cnrhWByE-bDlFbb_QavLQdTkODew-c0PXgm3PcoscRUbig3HlJyDbqTC3npvQ9-QYPuyjfqrDu7jimZnqDxureSZOllQjDARmvY9c Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:26:37.308053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b710b999eb884a96a85e9c6debe49306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b710b999eb884a96a85e9c6debe49306"}]}] Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 2e3ea44b40d9419aa51e0fa691d8dce9 Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Volume tempest-invalid-1806967117 could not be found. Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'tempest-invalid-1806967117'} Jun 03 15:26:37.309454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1806967117 could not be found. (HTTP 404) (Request-ID: req-7e169215-461d-4b73-a4c8-b84809ff3dd9) Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:37.310317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 15:26:37.311518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1806967117 could not be found. Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:26:37.312639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1806967117 could not be found. Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1806967117 could not be found. Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a77cbc72-479e-4739-afb4-f1b8a5430f80 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Returning 404 to user: Volume tempest-invalid-1806967117 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a77cbc72-479e-4739-afb4-f1b8a5430f80 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1806967117" status: 404 len: 99 microversion: 2.1 time: 0.946143 Jun 03 15:26:37.313774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 4/4] 10.222.0.93 () {58 vars in 1217 bytes} [Fri Jun 3 15:26:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1806967117 => generated 99 bytes in 947 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 03 15:26:37.344634 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-60869775-cc6d-4d56-8794-5bf31a0ba2f4 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017195 Jun 03 15:26:37.348226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 5/5] 10.222.0.93 () {58 vars in 1139 bytes} [Fri Jun 3 15:26:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 15:26:37.362385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5819bc8f-16c1-45ba-8691-1b2bacef32a9 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007104 Jun 03 15:26:37.364796 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 6/6] 10.222.0.93 () {58 vars in 1136 bytes} [Fri Jun 3 15:26:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 03 15:26:37.378098 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-97cc7a37-e5a9-400f-b979-790b88a51792 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Calling method '.version_select at 0x7f92f2ab9790>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:37.604598 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-97cc7a37-e5a9-400f-b979-790b88a51792 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] HTTP exception thrown: Volume 8fa67603-6d6d-4495-b971-96283ff6380d could not be found. Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-97cc7a37-e5a9-400f-b979-790b88a51792 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Request method failure captured: Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: DELETE /compute/v2.1/os-volumes/8fa67603-6d6d-4495-b971-96283ff6380d HTTP/1.1 Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigq2AKb0sd7fa_TSTH0Kk_YcEbbkccxLu8YXgGokzlBtYXILFionuiRR6a3jP7iZKdTuccS92cnrhWByE-bDlFbb_QavLQdTkODew-c0PXgm3PcoscRUbig3HlJyDbqTC3npvQ9-QYPuyjfqrDu7jimZnqDxureSZOllQjDARmvY9c Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:26:37.607006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b710b999eb884a96a85e9c6debe49306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b710b999eb884a96a85e9c6debe49306"}]}] Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 2e3ea44b40d9419aa51e0fa691d8dce9 Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Volume 8fa67603-6d6d-4495-b971-96283ff6380d could not be found. Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '8fa67603-6d6d-4495-b971-96283ff6380d'} Jun 03 15:26:37.608597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8fa67603-6d6d-4495-b971-96283ff6380d could not be found. (HTTP 404) (Request-ID: req-4a46b89d-e0b1-4bfd-8331-b2a1a0e4e6be) Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:37.609628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 15:26:37.611036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8fa67603-6d6d-4495-b971-96283ff6380d could not be found. Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 15:26:37.612338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8fa67603-6d6d-4495-b971-96283ff6380d could not be found. Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8fa67603-6d6d-4495-b971-96283ff6380d could not be found. Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.613830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-97cc7a37-e5a9-400f-b979-790b88a51792 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Returning 404 to user: Volume 8fa67603-6d6d-4495-b971-96283ff6380d could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:26:37.615307 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] validate_networks() for [('fa379d02-cec4-4bb7-8616-f922a2f53449', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:26:37.615412 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-97cc7a37-e5a9-400f-b979-790b88a51792 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/8fa67603-6d6d-4495-b971-96283ff6380d" status: 404 len: 109 microversion: 2.1 time: 0.237163 Jun 03 15:26:37.615412 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 7/7] 10.222.0.93 () {58 vars in 1247 bytes} [Fri Jun 3 15:26:37 2022] DELETE /compute/v2.1/os-volumes/8fa67603-6d6d-4495-b971-96283ff6380d => generated 109 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:26:37.619904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c6cb80c5-bfd2-44d4-bb9f-b6e8b7254108 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Calling method '.version_select at 0x7f92f2ab9280>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:37.815768 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-c6cb80c5-bfd2-44d4-bb9f-b6e8b7254108 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] HTTP exception thrown: Volume a5c56bbe-c464-4a14-acec-2e90b3aef7d7 could not be found. Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c6cb80c5-bfd2-44d4-bb9f-b6e8b7254108 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Request method failure captured: Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/os-volumes/a5c56bbe-c464-4a14-acec-2e90b3aef7d7 HTTP/1.1 Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigq2AKb0sd7fa_TSTH0Kk_YcEbbkccxLu8YXgGokzlBtYXILFionuiRR6a3jP7iZKdTuccS92cnrhWByE-bDlFbb_QavLQdTkODew-c0PXgm3PcoscRUbig3HlJyDbqTC3npvQ9-QYPuyjfqrDu7jimZnqDxureSZOllQjDARmvY9c Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:26:37.817764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b710b999eb884a96a85e9c6debe49306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b710b999eb884a96a85e9c6debe49306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b710b999eb884a96a85e9c6debe49306"}]}] Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: b710b999eb884a96a85e9c6debe49306 Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesNegativeTest-588170558 Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 2e3ea44b40d9419aa51e0fa691d8dce9 Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesNegativeTest-588170558-project Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Volume a5c56bbe-c464-4a14-acec-2e90b3aef7d7 could not be found. Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'a5c56bbe-c464-4a14-acec-2e90b3aef7d7'} Jun 03 15:26:37.819141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5c56bbe-c464-4a14-acec-2e90b3aef7d7 could not be found. (HTTP 404) (Request-ID: req-bcd05325-bc47-425d-8157-3ce395c09cc4) Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:37.820143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 15:26:37.859238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5c56bbe-c464-4a14-acec-2e90b3aef7d7 could not be found. Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 15:26:37.861589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5c56bbe-c464-4a14-acec-2e90b3aef7d7 could not be found. Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5c56bbe-c464-4a14-acec-2e90b3aef7d7 could not be found. Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c6cb80c5-bfd2-44d4-bb9f-b6e8b7254108 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] Returning 404 to user: Volume a5c56bbe-c464-4a14-acec-2e90b3aef7d7 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c6cb80c5-bfd2-44d4-bb9f-b6e8b7254108 tempest-VolumesNegativeTest-588170558 tempest-VolumesNegativeTest-588170558-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/a5c56bbe-c464-4a14-acec-2e90b3aef7d7" status: 404 len: 109 microversion: 2.1 time: 0.203219 Jun 03 15:26:37.862727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 8/8] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:26:37 2022] GET /compute/v2.1/os-volumes/a5c56bbe-c464-4a14-acec-2e90b3aef7d7 => generated 109 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:26:39.295266 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:26:39.295701 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:26:39.296051 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:26:39.296465 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:26:39.296871 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:26:39.325638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:39.326083 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:39.326901 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:39.327326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:39.423114 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Getting quotas for project 683acaeef18d43b4ac3daeb60e3a8aea. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:26:39.455252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Getting quotas for user bdd62219456547db82c2f5416d4f44f6 and project 683acaeef18d43b4ac3daeb60e3a8aea. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:26:39.521959 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:26:39.533992 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:26:39.750941 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c7afd20a-441c-44f2-9fbd-1f0785000fa3 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.266615 Jun 03 15:26:39.751607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 1/9] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:26:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 15:26:39.764436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1907d4d9-9f55-4a85-a612-e0421aa9f0c7 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:39.765590 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1907d4d9-9f55-4a85-a612-e0421aa9f0c7 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:40.039381 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1907d4d9-9f55-4a85-a612-e0421aa9f0c7 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:26:40.069513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1907d4d9-9f55-4a85-a612-e0421aa9f0c7 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1215 microversion: 2.1 time: 0.311389 Jun 03 15:26:40.072535 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 9/10] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:39 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1215 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:26:41.090086 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4abfd6f3-c53b-4851-9fcd-9fe8f313f313 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:41.091602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4abfd6f3-c53b-4851-9fcd-9fe8f313f313 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:41.510342 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4abfd6f3-c53b-4851-9fcd-9fe8f313f313 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:26:41.556010 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4abfd6f3-c53b-4851-9fcd-9fe8f313f313 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1215 microversion: 2.1 time: 0.469923 Jun 03 15:26:41.567426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 2/11] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:41 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1215 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:26:42.577702 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3d3602f2-5e71-4b8f-a3e7-f441a1db0d08 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:42.579089 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3d3602f2-5e71-4b8f-a3e7-f441a1db0d08 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:42.587025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3d3602f2-5e71-4b8f-a3e7-f441a1db0d08 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:42.587841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3d3602f2-5e71-4b8f-a3e7-f441a1db0d08 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:42.588843 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3d3602f2-5e71-4b8f-a3e7-f441a1db0d08 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:42.589476 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3d3602f2-5e71-4b8f-a3e7-f441a1db0d08 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:43.190834 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3d3602f2-5e71-4b8f-a3e7-f441a1db0d08 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:26:43.222184 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3d3602f2-5e71-4b8f-a3e7-f441a1db0d08 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1267 microversion: 2.1 time: 0.650329 Jun 03 15:26:43.234148 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 10/12] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:42 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1267 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:26:43.597340 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4f486ef0-0105-4b1a-a0fb-2f5111f0629a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'create', calling method: .version_select at 0x7f92f22df3a0>, body: {"keypair": {"name": "tempest-keypair-959807678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXrZwVsS3E9o+HV/JJM/89dhNCJQ4LbbvXbVqFTrIzpMlrgx6X7J52J8jpayUpPT862sARtyh1DSiHLfB4AW1QlmA9UYK921FwaiapfHmsVWIXVl1UGLW9vvgL5Wyln4w=="}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:26:43.704871 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-4f486ef0-0105-4b1a-a0fb-2f5111f0629a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Getting quotas for project 16edd3f309d54728882acc6d23f8861e. Resources: {'key_pairs'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:26:43.718575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-4f486ef0-0105-4b1a-a0fb-2f5111f0629a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Getting quotas for user 8632496bdc1b4d06a74caf483c8b0a42 and project 16edd3f309d54728882acc6d23f8861e. Resources: {'key_pairs'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:26:43.813179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4f486ef0-0105-4b1a-a0fb-2f5111f0629a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.713490 Jun 03 15:26:43.813887 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 3/13] 10.222.0.93 () {60 vars in 1158 bytes} [Fri Jun 3 15:26:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:26:44.251771 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b19703a6-d8ec-4c25-9716-6857e1958380 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:44.252459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b19703a6-d8ec-4c25-9716-6857e1958380 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:44.264140 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b19703a6-d8ec-4c25-9716-6857e1958380 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:44.264685 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b19703a6-d8ec-4c25-9716-6857e1958380 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:44.265355 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b19703a6-d8ec-4c25-9716-6857e1958380 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:44.267448 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b19703a6-d8ec-4c25-9716-6857e1958380 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:44.639766 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b19703a6-d8ec-4c25-9716-6857e1958380 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:26:44.648402 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b19703a6-d8ec-4c25-9716-6857e1958380 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1273 microversion: 2.1 time: 0.401473 Jun 03 15:26:44.667479 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 11/14] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:44 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1273 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:26:45.674507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5d7dc615-7ff4-421c-9e58-fd668004cd70 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:45.675777 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5d7dc615-7ff4-421c-9e58-fd668004cd70 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:45.692419 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5d7dc615-7ff4-421c-9e58-fd668004cd70 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:45.699386 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5d7dc615-7ff4-421c-9e58-fd668004cd70 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:45.703678 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5d7dc615-7ff4-421c-9e58-fd668004cd70 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:45.704992 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5d7dc615-7ff4-421c-9e58-fd668004cd70 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:46.751412 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5d7dc615-7ff4-421c-9e58-fd668004cd70 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:26:46.801552 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5d7dc615-7ff4-421c-9e58-fd668004cd70 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1273 microversion: 2.1 time: 1.133106 Jun 03 15:26:46.806733 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 4/15] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:45 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1273 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:26:47.828632 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8f3199b3-680b-46e9-a3b2-cd42d53e5fa6 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:47.829244 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8f3199b3-680b-46e9-a3b2-cd42d53e5fa6 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:47.838222 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f3199b3-680b-46e9-a3b2-cd42d53e5fa6 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:47.846523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f3199b3-680b-46e9-a3b2-cd42d53e5fa6 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:47.847488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f3199b3-680b-46e9-a3b2-cd42d53e5fa6 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:47.850292 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f3199b3-680b-46e9-a3b2-cd42d53e5fa6 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:49.271723 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8f3199b3-680b-46e9-a3b2-cd42d53e5fa6 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:26:49.281020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8f3199b3-680b-46e9-a3b2-cd42d53e5fa6 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 1.456056 Jun 03 15:26:49.287302 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 12/16] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:47 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:26:50.311529 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4e74fa22-a557-438b-9515-fde89a66852b tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:50.315244 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4e74fa22-a557-438b-9515-fde89a66852b tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:50.320040 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:50.365930 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e74fa22-a557-438b-9515-fde89a66852b tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:50.367005 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e74fa22-a557-438b-9515-fde89a66852b tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:50.368734 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e74fa22-a557-438b-9515-fde89a66852b tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:50.371651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e74fa22-a557-438b-9515-fde89a66852b tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:50.442267 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:50.934246 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4e74fa22-a557-438b-9515-fde89a66852b tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:26:50.956648 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4e74fa22-a557-438b-9515-fde89a66852b tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.655116 Jun 03 15:26:50.965993 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 5/17] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:50 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:26:51.326935 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4cee842a-fb87-47d6-8351-0dd4c9ffd896 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: .version_select at 0x7f92f29da280>, body: {"keypair": {"name": "tempest-keypair-1875216572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEadmHkU2dlbcBLP7IzLHLBZ/ZK107z0hQW6VujAnZAnSnL4u3BDoIL3M+f85YqD4XxX8UE/dg0mKc+QtmG0wAFx5dlASjQjbSQpphxfcIBkL4+hdwObvu9exty46TdS0A=="}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:26:51.484367 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-4cee842a-fb87-47d6-8351-0dd4c9ffd896 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:26:51.494612 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-4cee842a-fb87-47d6-8351-0dd4c9ffd896 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for user 193a35a91a47410f8b12cb2e84b33e1f and project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:26:51.622765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4cee842a-fb87-47d6-8351-0dd4c9ffd896 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.189145 Jun 03 15:26:51.640345 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 13/18] 10.222.0.93 () {60 vars in 1158 bytes} [Fri Jun 3 15:26:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:26:51.983167 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6f9544c1-cc06-42aa-a65a-c45d80f91660 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:51.983754 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6f9544c1-cc06-42aa-a65a-c45d80f91660 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:52.004711 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6f9544c1-cc06-42aa-a65a-c45d80f91660 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:52.009426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6f9544c1-cc06-42aa-a65a-c45d80f91660 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:52.035349 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6f9544c1-cc06-42aa-a65a-c45d80f91660 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:52.037532 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6f9544c1-cc06-42aa-a65a-c45d80f91660 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:53.403974 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6f9544c1-cc06-42aa-a65a-c45d80f91660 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:26:53.428682 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6f9544c1-cc06-42aa-a65a-c45d80f91660 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 1.450333 Jun 03 15:26:53.442548 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 6/19] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:51 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:26:53.794289 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-b657affd-9520-4646-90c3-76ed8418b06b req-e31c1794-fa12-464c-be6c-8c5c5cbd28fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7caaae-2b81-44c6-9fbb-a01d2af87b57", "tag": "e2167245-4216-4805-83ad-80b71ead6e3d"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:26:53.824585 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-b657affd-9520-4646-90c3-76ed8418b06b req-e31c1794-fa12-464c-be6c-8c5c5cbd28fd service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:53.825026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-b657affd-9520-4646-90c3-76ed8418b06b req-e31c1794-fa12-464c-be6c-8c5c5cbd28fd service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:53.926468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-b657affd-9520-4646-90c3-76ed8418b06b req-e31c1794-fa12-464c-be6c-8c5c5cbd28fd service nova] Creating event network-changed:e2167245-4216-4805-83ad-80b71ead6e3d for instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 on hv-cinder-83124 Jun 03 15:26:53.936494 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-b657affd-9520-4646-90c3-76ed8418b06b req-e31c1794-fa12-464c-be6c-8c5c5cbd28fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=117806) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 15:26:53.937708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-999b5f92-832a-4c6a-8575-919cb3bc0fbe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:53.938153 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-999b5f92-832a-4c6a-8575-919cb3bc0fbe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:53.938980 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-999b5f92-832a-4c6a-8575-919cb3bc0fbe None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:53.939410 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-999b5f92-832a-4c6a-8575-919cb3bc0fbe None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:53.984218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.compute.rpcapi [None req-999b5f92-832a-4c6a-8575-919cb3bc0fbe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 15:26:53.985454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-999b5f92-832a-4c6a-8575-919cb3bc0fbe None None] Releasing lock "compute-rpcapi-router" {{(pid=117806) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 15:26:54.083647 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-999b5f92-832a-4c6a-8575-919cb3bc0fbe None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.557012 Jun 03 15:26:54.084229 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 14/20] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:26:54.446873 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3af4a742-87b8-47d8-9ec3-44fd4bba3f41 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:54.449639 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3af4a742-87b8-47d8-9ec3-44fd4bba3f41 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:54.452843 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=12 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:26:54.477271 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3af4a742-87b8-47d8-9ec3-44fd4bba3f41 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:54.478524 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3af4a742-87b8-47d8-9ec3-44fd4bba3f41 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:54.479589 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3af4a742-87b8-47d8-9ec3-44fd4bba3f41 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:54.480231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3af4a742-87b8-47d8-9ec3-44fd4bba3f41 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:55.268571 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3af4a742-87b8-47d8-9ec3-44fd4bba3f41 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:26:55.277235 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3af4a742-87b8-47d8-9ec3-44fd4bba3f41 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.834696 Jun 03 15:26:55.288919 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 7/21] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:54 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:26:56.307834 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-571a6471-8e2c-4eb9-a905-f392cb0c3143 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:56.309424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-571a6471-8e2c-4eb9-a905-f392cb0c3143 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:56.330218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-571a6471-8e2c-4eb9-a905-f392cb0c3143 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:56.331090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-571a6471-8e2c-4eb9-a905-f392cb0c3143 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:56.334228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-571a6471-8e2c-4eb9-a905-f392cb0c3143 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:56.339097 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-571a6471-8e2c-4eb9-a905-f392cb0c3143 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:58.489713 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-571a6471-8e2c-4eb9-a905-f392cb0c3143 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:26:58.537296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-571a6471-8e2c-4eb9-a905-f392cb0c3143 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 2.234252 Jun 03 15:26:58.541310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 15/22] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:56 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 2240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:26:59.560196 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-72904923-b2c0-4876-b8b8-15efe5b9e570 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:26:59.561654 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-72904923-b2c0-4876-b8b8-15efe5b9e570 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:26:59.582960 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-72904923-b2c0-4876-b8b8-15efe5b9e570 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:59.587254 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-72904923-b2c0-4876-b8b8-15efe5b9e570 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:26:59.594686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-72904923-b2c0-4876-b8b8-15efe5b9e570 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:26:59.595570 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-72904923-b2c0-4876-b8b8-15efe5b9e570 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:00.236016 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-72904923-b2c0-4876-b8b8-15efe5b9e570 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:00.252213 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-72904923-b2c0-4876-b8b8-15efe5b9e570 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.698619 Jun 03 15:27:00.256765 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 8/23] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:26:59 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:00.480217 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1785066658", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68719859-5880-402e-b442-370597e1ce2f"}], "security_groups": [{"name": "tempest-securitygroup--1203465604"}], "key_name": "tempest-keypair-1875216572", "user_data": "}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:01.214900 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.network.neutron [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] validate_networks() for [('68719859-5880-402e-b442-370597e1ce2f', None, None, None, None, None)] {{(pid=117806) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:27:01.241832 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-108199068", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc85e51d-f7a3-45da-ad6c-8c73a576aa2c"}], "security_groups": [{"name": "tempest-securitygroup--1095991716"}], "key_name": "tempest-keypair-959807678", "user_data": "}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:01.501260 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] validate_networks() for [('fc85e51d-f7a3-45da-ad6c-8c73a576aa2c', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:27:01.514630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=4 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:02.448554 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:27:02.449048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:27:02.449447 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:27:02.450366 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:27:02.450994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:27:02.472923 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:02.473381 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:02.482468 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:02.482969 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:02.588374 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Getting quotas for project 16edd3f309d54728882acc6d23f8861e. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:27:02.628355 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Getting quotas for user 8632496bdc1b4d06a74caf483c8b0a42 and project 16edd3f309d54728882acc6d23f8861e. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:27:02.696291 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:27:02.701049 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:27:02.887925 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f3e90d43-6afb-4958-9029-bb01d03f9130 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.651996 Jun 03 15:27:02.904954 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 9/24] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:27:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 15:27:02.919222 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a8ae05ca-ecce-4cbe-a7a0-10206cfc4462 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:02.920070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a8ae05ca-ecce-4cbe-a7a0-10206cfc4462 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:02.951275 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8ae05ca-ecce-4cbe-a7a0-10206cfc4462 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:02.953279 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8ae05ca-ecce-4cbe-a7a0-10206cfc4462 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:02.955620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8ae05ca-ecce-4cbe-a7a0-10206cfc4462 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:02.960904 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8ae05ca-ecce-4cbe-a7a0-10206cfc4462 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:03.455585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a8ae05ca-ecce-4cbe-a7a0-10206cfc4462 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:03.464191 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a8ae05ca-ecce-4cbe-a7a0-10206cfc4462 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.555657 Jun 03 15:27:03.464844 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 10/25] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:02 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:03.933736 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Flavor limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:27:03.934253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Image limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:27:03.935135 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Flavor pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:27:03.935742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Image pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:27:03.936224 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:27:03.961609 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:03.964536 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:03.975956 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:03.976591 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:04.027390 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1895763288", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:04.046459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:27:04.059295 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for user 193a35a91a47410f8b12cb2e84b33e1f and project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:27:04.093893 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Going to run 1 instances... {{(pid=117806) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:27:04.102938 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:27:04.155823 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] validate_networks() for [('ba66765f-7c24-4296-be5e-4c2a803ccabf', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:27:04.251934 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4347054c-083a-44ae-a50c-73b2a2fe5f4e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.776285 Jun 03 15:27:04.252618 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 16/26] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:27:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 3778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:27:04.263348 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2200d731-b9d5-4b07-86f4-afce34fda937 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:04.263981 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2200d731-b9d5-4b07-86f4-afce34fda937 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:04.401519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2200d731-b9d5-4b07-86f4-afce34fda937 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:04.408421 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2200d731-b9d5-4b07-86f4-afce34fda937 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1236 microversion: 2.1 time: 0.149381 Jun 03 15:27:04.418907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 17/27] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:04 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1236 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:04.423832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bcff4a83-8cd0-4ba3-a515-0e2c440047f2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:04.424501 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-bcff4a83-8cd0-4ba3-a515-0e2c440047f2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:04.449034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:04.612949 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-bcff4a83-8cd0-4ba3-a515-0e2c440047f2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:04.622192 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-bcff4a83-8cd0-4ba3-a515-0e2c440047f2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1242 microversion: 2.1 time: 0.202023 Jun 03 15:27:04.623007 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 18/28] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:04 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1242 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:04.696230 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-08d420b7-e3ef-471f-8022-9d521cdb59d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Action: 'create', calling method: .version_select at 0x7f92f1091dc0>, body: {"keypair": {"name": "tempest-keypair-317052014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCche/ufSQ+cB8qMLQaxqDbjEZvX68jGXbXNGDlEozrRxQXmLh1XPU5b6mUQCKn3Ej9IdnrTsq+rLRR33pijlZdbK+of+oQ7gG1/PdCWiq78F1cFVdcbNUQdWCRYhqAZ8w=="}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:04.717801 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-08d420b7-e3ef-471f-8022-9d521cdb59d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Getting quotas for project 1b930cadb2dc4e49947db0514528617d. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:27:04.723334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-08d420b7-e3ef-471f-8022-9d521cdb59d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Getting quotas for user 47d7587d10b3487688ed251a85b83c97 and project 1b930cadb2dc4e49947db0514528617d. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:27:04.761335 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-08d420b7-e3ef-471f-8022-9d521cdb59d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.136497 Jun 03 15:27:04.783829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 19/29] 10.222.0.93 () {62 vars in 1199 bytes} [Fri Jun 3 15:27:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 15:27:04.800576 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7c533375-def8-43b1-94c8-6b2576ac44f0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:04.804018 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7c533375-def8-43b1-94c8-6b2576ac44f0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:04.830960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c533375-def8-43b1-94c8-6b2576ac44f0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:04.831435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c533375-def8-43b1-94c8-6b2576ac44f0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:04.836729 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c533375-def8-43b1-94c8-6b2576ac44f0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:04.838283 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c533375-def8-43b1-94c8-6b2576ac44f0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:04.861641 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=31 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:05.376443 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:27:05.377508 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:27:05.378403 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:27:05.379801 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:27:05.380065 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:27:05.401070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:05.402815 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:05.405917 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:05.407232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:05.445764 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Getting quotas for project a402ec1153624838be07cda58279f2a4. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:27:05.452391 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Getting quotas for user 127a6938bc5c4416a9a502d9064344cd and project a402ec1153624838be07cda58279f2a4. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:27:05.470475 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:27:05.475190 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:27:05.588802 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7c533375-def8-43b1-94c8-6b2576ac44f0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:05.605883 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d9437caa-a8ee-47dd-b796-4c6a96b9ab5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.133320 Jun 03 15:27:05.609105 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 11/30] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:27:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:27:05.616332 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7c533375-def8-43b1-94c8-6b2576ac44f0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.829770 Jun 03 15:27:05.622929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d0e31fd7-b10d-4896-8e36-0f39f4817f3a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:05.632433 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 20/31] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:04 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:05.634476 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d0e31fd7-b10d-4896-8e36-0f39f4817f3a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:05.634476 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=10 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:05.640548 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d0e31fd7-b10d-4896-8e36-0f39f4817f3a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:05.646125 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d0e31fd7-b10d-4896-8e36-0f39f4817f3a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:05.647262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d0e31fd7-b10d-4896-8e36-0f39f4817f3a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:05.647728 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d0e31fd7-b10d-4896-8e36-0f39f4817f3a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:05.666918 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7d3cdfbb-6011-43cd-b1a7-139d53522f5e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:05.668095 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7d3cdfbb-6011-43cd-b1a7-139d53522f5e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:05.685222 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=43 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:05.809273 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d0e31fd7-b10d-4896-8e36-0f39f4817f3a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:05.828949 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d0e31fd7-b10d-4896-8e36-0f39f4817f3a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1240 microversion: 2.1 time: 0.218412 Jun 03 15:27:05.842243 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 12/32] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:05 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1240 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:05.848019 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-32e69d92-eb98-47c5-aae9-c4e1b9a4a677 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:05.849041 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-32e69d92-eb98-47c5-aae9-c4e1b9a4a677 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:05.856893 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32e69d92-eb98-47c5-aae9-c4e1b9a4a677 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:05.857684 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32e69d92-eb98-47c5-aae9-c4e1b9a4a677 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:05.868600 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32e69d92-eb98-47c5-aae9-c4e1b9a4a677 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:05.869205 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32e69d92-eb98-47c5-aae9-c4e1b9a4a677 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:05.935495 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7d3cdfbb-6011-43cd-b1a7-139d53522f5e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:05.950486 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7d3cdfbb-6011-43cd-b1a7-139d53522f5e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1222 microversion: 2.1 time: 0.323563 Jun 03 15:27:05.954726 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 21/33] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:05 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1222 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:05.984586 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-32e69d92-eb98-47c5-aae9-c4e1b9a4a677 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:06.001380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-32e69d92-eb98-47c5-aae9-c4e1b9a4a677 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1246 microversion: 2.1 time: 0.157584 Jun 03 15:27:06.002629 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 13/34] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:05 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1246 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:06.240109 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1598750294", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:06.422001 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.network.neutron [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] validate_networks() for [('ba66765f-7c24-4296-be5e-4c2a803ccabf', None, None, None, None, None)] {{(pid=117806) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:27:06.645178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-919fcb00-6f43-42d0-a6dc-3ee589d15082 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:06.646140 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-919fcb00-6f43-42d0-a6dc-3ee589d15082 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:06.669776 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-919fcb00-6f43-42d0-a6dc-3ee589d15082 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:06.670448 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-919fcb00-6f43-42d0-a6dc-3ee589d15082 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:06.672156 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-919fcb00-6f43-42d0-a6dc-3ee589d15082 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:06.672644 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-919fcb00-6f43-42d0-a6dc-3ee589d15082 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:06.912285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-919fcb00-6f43-42d0-a6dc-3ee589d15082 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:06.926916 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-919fcb00-6f43-42d0-a6dc-3ee589d15082 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.289069 Jun 03 15:27:06.927522 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 14/35] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:06 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:06.932919 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-20f9018f-88c5-4006-93a8-bcedf062fc8c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:06.933534 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-20f9018f-88c5-4006-93a8-bcedf062fc8c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:06.950300 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20f9018f-88c5-4006-93a8-bcedf062fc8c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:06.965131 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20f9018f-88c5-4006-93a8-bcedf062fc8c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:06.966114 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20f9018f-88c5-4006-93a8-bcedf062fc8c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:06.967271 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20f9018f-88c5-4006-93a8-bcedf062fc8c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:07.073026 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-20f9018f-88c5-4006-93a8-bcedf062fc8c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:07.083617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-20f9018f-88c5-4006-93a8-bcedf062fc8c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1288 microversion: 2.1 time: 0.154785 Jun 03 15:27:07.084991 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 15/36] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:06 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1288 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:07.101391 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ff279245-2821-418e-ade7-5afe270c1685 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:07.102294 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ff279245-2821-418e-ade7-5afe270c1685 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:07.121313 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ff279245-2821-418e-ade7-5afe270c1685 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:07.122135 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ff279245-2821-418e-ade7-5afe270c1685 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:07.123190 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ff279245-2821-418e-ade7-5afe270c1685 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:07.123812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ff279245-2821-418e-ade7-5afe270c1685 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:07.218316 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ff279245-2821-418e-ade7-5afe270c1685 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:07.237899 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ff279245-2821-418e-ade7-5afe270c1685 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1294 microversion: 2.1 time: 0.151638 Jun 03 15:27:07.239313 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 16/37] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:07 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1294 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:07.341518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Flavor limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:27:07.341977 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Image limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:27:07.342833 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Flavor pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:27:07.343270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Image pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:27:07.343694 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:27:07.362955 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:07.363436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:07.376531 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:07.377106 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:07.428618 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Getting quotas for project a402ec1153624838be07cda58279f2a4. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:27:07.441511 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Getting quotas for user 127a6938bc5c4416a9a502d9064344cd and project a402ec1153624838be07cda58279f2a4. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:27:07.513641 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Going to run 1 instances... {{(pid=117806) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:27:07.521551 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:27:07.700900 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5189b759-ee7a-409a-830f-30019d7e628b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.469243 Jun 03 15:27:07.702112 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 22/38] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:27:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:27:07.715672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-055b19fa-0735-4a4b-a4dc-f855914c3cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:07.716294 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-055b19fa-0735-4a4b-a4dc-f855914c3cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:07.962862 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-387c9e4d-7b99-4bb5-9897-1c35160d61e0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:07.964164 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-387c9e4d-7b99-4bb5-9897-1c35160d61e0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:07.994734 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-387c9e4d-7b99-4bb5-9897-1c35160d61e0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:07.995647 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-387c9e4d-7b99-4bb5-9897-1c35160d61e0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:07.998257 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-387c9e4d-7b99-4bb5-9897-1c35160d61e0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:07.999740 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-387c9e4d-7b99-4bb5-9897-1c35160d61e0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:08.030169 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-055b19fa-0735-4a4b-a4dc-f855914c3cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:08.041047 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-055b19fa-0735-4a4b-a4dc-f855914c3cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1222 microversion: 2.1 time: 0.332646 Jun 03 15:27:08.042198 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 17/39] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:07 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1222 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:08.102516 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-efde332a-fa2a-4a4d-88f2-966a1cb46e41 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:08.103526 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-efde332a-fa2a-4a4d-88f2-966a1cb46e41 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:08.114082 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-efde332a-fa2a-4a4d-88f2-966a1cb46e41 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:08.118190 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-efde332a-fa2a-4a4d-88f2-966a1cb46e41 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:08.119513 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-efde332a-fa2a-4a4d-88f2-966a1cb46e41 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:08.121793 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-efde332a-fa2a-4a4d-88f2-966a1cb46e41 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:08.232928 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-efde332a-fa2a-4a4d-88f2-966a1cb46e41 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:08.241985 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-efde332a-fa2a-4a4d-88f2-966a1cb46e41 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1288 microversion: 2.1 time: 0.144418 Jun 03 15:27:08.253438 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 18/40] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:08 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1288 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:08.266133 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-03a743fb-1cc7-4eff-84d4-e81051cc85a1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:08.270378 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-03a743fb-1cc7-4eff-84d4-e81051cc85a1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:08.288595 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-03a743fb-1cc7-4eff-84d4-e81051cc85a1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:08.289934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-03a743fb-1cc7-4eff-84d4-e81051cc85a1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:08.291181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-03a743fb-1cc7-4eff-84d4-e81051cc85a1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:08.292049 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-03a743fb-1cc7-4eff-84d4-e81051cc85a1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:08.391899 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-03a743fb-1cc7-4eff-84d4-e81051cc85a1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:08.399208 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-387c9e4d-7b99-4bb5-9897-1c35160d61e0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:08.403123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-03a743fb-1cc7-4eff-84d4-e81051cc85a1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1294 microversion: 2.1 time: 0.147108 Jun 03 15:27:08.404595 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 19/41] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:08 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1294 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:08.410883 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-387c9e4d-7b99-4bb5-9897-1c35160d61e0 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.453185 Jun 03 15:27:08.412096 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 23/42] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:07 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:08.560920 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-809360109", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6297c62b-cf60-4797-8fdd-d236a362ff82"}], "security_groups": [{"name": "tempest-securitygroup--2146882617"}], "key_name": "tempest-keypair-317052014", "user_data": "}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:08.730066 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] validate_networks() for [('6297c62b-cf60-4797-8fdd-d236a362ff82', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:27:09.059493 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8fa9227c-2865-47a8-b2f3-7b7f410b27cf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:09.060207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8fa9227c-2865-47a8-b2f3-7b7f410b27cf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:09.066873 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8fa9227c-2865-47a8-b2f3-7b7f410b27cf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:09.067419 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8fa9227c-2865-47a8-b2f3-7b7f410b27cf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:09.068486 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8fa9227c-2865-47a8-b2f3-7b7f410b27cf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:09.069333 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8fa9227c-2865-47a8-b2f3-7b7f410b27cf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:09.156591 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8fa9227c-2865-47a8-b2f3-7b7f410b27cf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:09.165796 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8fa9227c-2865-47a8-b2f3-7b7f410b27cf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1226 microversion: 2.1 time: 0.110945 Jun 03 15:27:09.175167 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 24/43] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:09 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:09.175825 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:27:09.176253 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:27:09.176731 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:27:09.177170 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:27:09.178012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:27:09.187529 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:09.187917 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:09.188945 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:09.189385 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:09.207052 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Getting quotas for project 1b930cadb2dc4e49947db0514528617d. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:27:09.211595 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Getting quotas for user 47d7587d10b3487688ed251a85b83c97 and project 1b930cadb2dc4e49947db0514528617d. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:27:09.236347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:27:09.238798 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:27:09.262929 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-827a7438-de5f-4324-9f38-274dc3860164 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:09.263555 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-827a7438-de5f-4324-9f38-274dc3860164 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:09.274595 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-827a7438-de5f-4324-9f38-274dc3860164 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:09.275070 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-827a7438-de5f-4324-9f38-274dc3860164 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:09.279329 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-827a7438-de5f-4324-9f38-274dc3860164 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:09.280079 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-827a7438-de5f-4324-9f38-274dc3860164 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:09.341845 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-41de7d11-83b5-4ddd-82bb-8e6a7f5da9c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.784035 Jun 03 15:27:09.342652 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 20/44] 10.222.0.93 () {62 vars in 1187 bytes} [Fri Jun 3 15:27:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 15:27:09.377595 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-dd38d1cb-b9ba-4265-9bfb-2ed5999c8e50 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:09.378307 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-dd38d1cb-b9ba-4265-9bfb-2ed5999c8e50 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:09.404076 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-827a7438-de5f-4324-9f38-274dc3860164 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:09.414893 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-827a7438-de5f-4324-9f38-274dc3860164 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1288 microversion: 2.1 time: 0.157966 Jun 03 15:27:09.426998 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 25/45] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:09 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1288 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:09.432980 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-33cf8141-1348-46b1-840a-330074d333b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:09.433867 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-33cf8141-1348-46b1-840a-330074d333b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:09.451765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-33cf8141-1348-46b1-840a-330074d333b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:09.455587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-33cf8141-1348-46b1-840a-330074d333b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:09.457902 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-33cf8141-1348-46b1-840a-330074d333b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:09.459420 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-33cf8141-1348-46b1-840a-330074d333b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:09.459574 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dd38d1cb-b9ba-4265-9bfb-2ed5999c8e50 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:09.480049 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dd38d1cb-b9ba-4265-9bfb-2ed5999c8e50 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:09.482029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dd38d1cb-b9ba-4265-9bfb-2ed5999c8e50 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:09.487204 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-dd38d1cb-b9ba-4265-9bfb-2ed5999c8e50 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1280 microversion: 2.20 time: 0.128772 Jun 03 15:27:09.498328 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 21/46] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:09 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:09.498328 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-dde1fa4c-2995-4b55-9bca-8092c74cd7e5 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:09.498328 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-dde1fa4c-2995-4b55-9bca-8092c74cd7e5 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:09.503387 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dde1fa4c-2995-4b55-9bca-8092c74cd7e5 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:09.503841 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dde1fa4c-2995-4b55-9bca-8092c74cd7e5 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:09.505224 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dde1fa4c-2995-4b55-9bca-8092c74cd7e5 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:09.505848 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dde1fa4c-2995-4b55-9bca-8092c74cd7e5 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:09.600434 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-33cf8141-1348-46b1-840a-330074d333b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:09.641357 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-33cf8141-1348-46b1-840a-330074d333b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1294 microversion: 2.1 time: 0.211798 Jun 03 15:27:09.649587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 26/47] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:09 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:09.807688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dde1fa4c-2995-4b55-9bca-8092c74cd7e5 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:09.821471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-dde1fa4c-2995-4b55-9bca-8092c74cd7e5 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.331293 Jun 03 15:27:09.824892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 22/48] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:09 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:10.183536 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-36c66a34-c92e-4df0-bd44-958b8425d008 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:10.184484 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-36c66a34-c92e-4df0-bd44-958b8425d008 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:10.199229 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-36c66a34-c92e-4df0-bd44-958b8425d008 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:10.201470 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-36c66a34-c92e-4df0-bd44-958b8425d008 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:10.205475 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-36c66a34-c92e-4df0-bd44-958b8425d008 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:10.207289 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-36c66a34-c92e-4df0-bd44-958b8425d008 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:10.331101 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-36c66a34-c92e-4df0-bd44-958b8425d008 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:10.345462 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-36c66a34-c92e-4df0-bd44-958b8425d008 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1218 microversion: 2.1 time: 0.163494 Jun 03 15:27:10.348187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 27/49] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:10 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:10.434581 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-16c761c0-39a0-4b63-a50e-5388508882f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:10.436814 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-16c761c0-39a0-4b63-a50e-5388508882f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:10.467386 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-16c761c0-39a0-4b63-a50e-5388508882f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:10.469213 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-16c761c0-39a0-4b63-a50e-5388508882f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:10.470052 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-16c761c0-39a0-4b63-a50e-5388508882f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:10.472187 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-16c761c0-39a0-4b63-a50e-5388508882f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:10.506344 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ced5be8a-bc5f-4b9a-91ae-df1e70083451 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:10.507058 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ced5be8a-bc5f-4b9a-91ae-df1e70083451 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:10.522569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ced5be8a-bc5f-4b9a-91ae-df1e70083451 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:10.523320 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ced5be8a-bc5f-4b9a-91ae-df1e70083451 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:10.524145 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ced5be8a-bc5f-4b9a-91ae-df1e70083451 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:10.525093 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ced5be8a-bc5f-4b9a-91ae-df1e70083451 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:10.578812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-16c761c0-39a0-4b63-a50e-5388508882f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:10.588460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-16c761c0-39a0-4b63-a50e-5388508882f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1306 microversion: 2.1 time: 0.158811 Jun 03 15:27:10.589572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 23/50] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:10 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1306 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:10.657742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ced5be8a-bc5f-4b9a-91ae-df1e70083451 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:10.667169 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-799f0297-1993-47ca-8409-a15696ee8304 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:10.667796 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-799f0297-1993-47ca-8409-a15696ee8304 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:10.671673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ced5be8a-bc5f-4b9a-91ae-df1e70083451 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:10.673405 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ced5be8a-bc5f-4b9a-91ae-df1e70083451 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:10.676029 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ced5be8a-bc5f-4b9a-91ae-df1e70083451 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1284 microversion: 2.20 time: 0.174256 Jun 03 15:27:10.677190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 28/51] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:10 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:10.684981 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-799f0297-1993-47ca-8409-a15696ee8304 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:10.685867 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-799f0297-1993-47ca-8409-a15696ee8304 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:10.687564 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-799f0297-1993-47ca-8409-a15696ee8304 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:10.688229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-799f0297-1993-47ca-8409-a15696ee8304 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:10.782285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-799f0297-1993-47ca-8409-a15696ee8304 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:10.795114 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-799f0297-1993-47ca-8409-a15696ee8304 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1312 microversion: 2.1 time: 0.133476 Jun 03 15:27:10.795714 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 24/52] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:10 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:10.840263 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-975c8d82-d165-45ce-bda3-1c8098868325 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:10.841120 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-975c8d82-d165-45ce-bda3-1c8098868325 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:10.857926 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-975c8d82-d165-45ce-bda3-1c8098868325 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:10.858438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-975c8d82-d165-45ce-bda3-1c8098868325 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:10.859461 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-975c8d82-d165-45ce-bda3-1c8098868325 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:10.860331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-975c8d82-d165-45ce-bda3-1c8098868325 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:11.045189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-975c8d82-d165-45ce-bda3-1c8098868325 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:11.053757 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-975c8d82-d165-45ce-bda3-1c8098868325 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.218526 Jun 03 15:27:11.065132 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 29/53] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:10 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:11.368331 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-87b38a76-f33c-4175-b977-1326fa0ed387 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:11.369908 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-87b38a76-f33c-4175-b977-1326fa0ed387 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:11.393640 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-87b38a76-f33c-4175-b977-1326fa0ed387 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:11.394131 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-87b38a76-f33c-4175-b977-1326fa0ed387 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:11.397675 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-87b38a76-f33c-4175-b977-1326fa0ed387 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:11.401259 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-87b38a76-f33c-4175-b977-1326fa0ed387 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:11.606968 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-10e39674-6e80-403f-833c-1693f026f311 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:11.608294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-10e39674-6e80-403f-833c-1693f026f311 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:11.620653 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-10e39674-6e80-403f-833c-1693f026f311 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:11.625529 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-10e39674-6e80-403f-833c-1693f026f311 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:11.626773 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-10e39674-6e80-403f-833c-1693f026f311 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:11.627440 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-10e39674-6e80-403f-833c-1693f026f311 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:11.688040 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-87b38a76-f33c-4175-b977-1326fa0ed387 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:11.704654 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-87b38a76-f33c-4175-b977-1326fa0ed387 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1282 microversion: 2.1 time: 0.340728 Jun 03 15:27:11.706973 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 25/54] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:11 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1282 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:11.729135 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-abddfe91-2315-48ed-83f5-6ba7ae361925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:11.729946 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-abddfe91-2315-48ed-83f5-6ba7ae361925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:11.759447 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-abddfe91-2315-48ed-83f5-6ba7ae361925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:11.760382 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-abddfe91-2315-48ed-83f5-6ba7ae361925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:11.763566 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-abddfe91-2315-48ed-83f5-6ba7ae361925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:11.764188 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-abddfe91-2315-48ed-83f5-6ba7ae361925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:12.089763 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-10e39674-6e80-403f-833c-1693f026f311 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:12.095393 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-abddfe91-2315-48ed-83f5-6ba7ae361925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:12.099269 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-abddfe91-2315-48ed-83f5-6ba7ae361925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:12.099924 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-10e39674-6e80-403f-833c-1693f026f311 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1294 microversion: 2.1 time: 0.496564 Jun 03 15:27:12.100799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-abddfe91-2315-48ed-83f5-6ba7ae361925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:12.100947 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 30/55] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:11 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1294 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:12.104670 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-abddfe91-2315-48ed-83f5-6ba7ae361925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1340 microversion: 2.20 time: 0.396006 Jun 03 15:27:12.105510 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 26/56] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:11 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1340 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:12.115797 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7ba4c316-8d2f-4fb2-8501-b525d4ac4f1a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:12.116761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7ba4c316-8d2f-4fb2-8501-b525d4ac4f1a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:12.133883 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7ba4c316-8d2f-4fb2-8501-b525d4ac4f1a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:12.134646 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7ba4c316-8d2f-4fb2-8501-b525d4ac4f1a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:12.135737 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7ba4c316-8d2f-4fb2-8501-b525d4ac4f1a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:12.136051 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-caee717b-5f3e-4398-be81-df412ef56fd9 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:12.136609 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7ba4c316-8d2f-4fb2-8501-b525d4ac4f1a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:12.140589 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-caee717b-5f3e-4398-be81-df412ef56fd9 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:12.154571 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-caee717b-5f3e-4398-be81-df412ef56fd9 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:12.155042 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-caee717b-5f3e-4398-be81-df412ef56fd9 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:12.155837 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-caee717b-5f3e-4398-be81-df412ef56fd9 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:12.156281 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-caee717b-5f3e-4398-be81-df412ef56fd9 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:12.279932 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7ba4c316-8d2f-4fb2-8501-b525d4ac4f1a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:12.289693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7ba4c316-8d2f-4fb2-8501-b525d4ac4f1a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1300 microversion: 2.1 time: 0.185847 Jun 03 15:27:12.293931 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 31/57] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:12 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1300 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:12.565290 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-caee717b-5f3e-4398-be81-df412ef56fd9 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:12.578615 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-caee717b-5f3e-4398-be81-df412ef56fd9 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.455207 Jun 03 15:27:12.579203 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 27/58] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:12 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:12.725123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-85d745cb-2179-45c2-9642-c70ef6c31e82 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:12.725997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-85d745cb-2179-45c2-9642-c70ef6c31e82 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:12.747698 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-85d745cb-2179-45c2-9642-c70ef6c31e82 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:12.749003 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-85d745cb-2179-45c2-9642-c70ef6c31e82 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:12.749972 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-85d745cb-2179-45c2-9642-c70ef6c31e82 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:12.750418 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-85d745cb-2179-45c2-9642-c70ef6c31e82 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:12.817349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-5a88d74f-24e4-4201-ab0d-ef29b775eeaf req-ad4b6547-05fb-4000-b1b4-6563b2de6d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7caaae-2b81-44c6-9fbb-a01d2af87b57", "name": "network-vif-plugged", "status": "completed", "tag": "e2167245-4216-4805-83ad-80b71ead6e3d"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:12.847407 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-5a88d74f-24e4-4201-ab0d-ef29b775eeaf req-ad4b6547-05fb-4000-b1b4-6563b2de6d02 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:12.848616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-5a88d74f-24e4-4201-ab0d-ef29b775eeaf req-ad4b6547-05fb-4000-b1b4-6563b2de6d02 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:12.866458 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-5a88d74f-24e4-4201-ab0d-ef29b775eeaf req-ad4b6547-05fb-4000-b1b4-6563b2de6d02 service nova] Creating event network-vif-plugged:e2167245-4216-4805-83ad-80b71ead6e3d for instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 on hv-cinder-83124 Jun 03 15:27:12.872792 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-5a88d74f-24e4-4201-ab0d-ef29b775eeaf req-ad4b6547-05fb-4000-b1b4-6563b2de6d02 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268313 Jun 03 15:27:12.874081 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 32/59] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:12.910289 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-85d745cb-2179-45c2-9642-c70ef6c31e82 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:12.919036 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-85d745cb-2179-45c2-9642-c70ef6c31e82 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1280 microversion: 2.1 time: 0.198925 Jun 03 15:27:12.928382 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 28/60] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:12 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:13.131979 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c33bb3ae-4a38-4286-89b8-4059a2aebece tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:13.132639 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-19b12f9a-637d-4543-a406-a4d15caea1e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:13.133885 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-19b12f9a-637d-4543-a406-a4d15caea1e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:13.136017 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c33bb3ae-4a38-4286-89b8-4059a2aebece tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:13.145129 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-19b12f9a-637d-4543-a406-a4d15caea1e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:13.150243 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-19b12f9a-637d-4543-a406-a4d15caea1e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:13.152568 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c33bb3ae-4a38-4286-89b8-4059a2aebece tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:13.153269 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c33bb3ae-4a38-4286-89b8-4059a2aebece tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:13.153623 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-19b12f9a-637d-4543-a406-a4d15caea1e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:13.154568 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c33bb3ae-4a38-4286-89b8-4059a2aebece tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:13.155468 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-19b12f9a-637d-4543-a406-a4d15caea1e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:13.158071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c33bb3ae-4a38-4286-89b8-4059a2aebece tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:13.287779 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-19b12f9a-637d-4543-a406-a4d15caea1e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:13.303027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-19b12f9a-637d-4543-a406-a4d15caea1e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:13.304587 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-19b12f9a-637d-4543-a406-a4d15caea1e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:13.305689 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-19b12f9a-637d-4543-a406-a4d15caea1e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1338 microversion: 2.20 time: 0.186002 Jun 03 15:27:13.306250 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 29/61] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:13 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1338 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:13.313995 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3e2721b5-5f63-4336-913c-b8f371e5fb1f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:13.314622 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3e2721b5-5f63-4336-913c-b8f371e5fb1f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:13.332146 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3e2721b5-5f63-4336-913c-b8f371e5fb1f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:13.333008 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3e2721b5-5f63-4336-913c-b8f371e5fb1f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:13.334042 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3e2721b5-5f63-4336-913c-b8f371e5fb1f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:13.334229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3e2721b5-5f63-4336-913c-b8f371e5fb1f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:13.385535 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c33bb3ae-4a38-4286-89b8-4059a2aebece tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:13.396647 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c33bb3ae-4a38-4286-89b8-4059a2aebece tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.280267 Jun 03 15:27:13.408810 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 33/62] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:13 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:13.561354 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3e2721b5-5f63-4336-913c-b8f371e5fb1f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:13.573157 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3e2721b5-5f63-4336-913c-b8f371e5fb1f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.262667 Jun 03 15:27:13.585896 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 30/63] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:13 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:13.595849 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-cc2e148c-a12d-4495-b412-51aa11e6c36e tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:13.596725 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-cc2e148c-a12d-4495-b412-51aa11e6c36e tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:13.610048 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cc2e148c-a12d-4495-b412-51aa11e6c36e tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:13.611190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cc2e148c-a12d-4495-b412-51aa11e6c36e tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:13.612930 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cc2e148c-a12d-4495-b412-51aa11e6c36e tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:13.614161 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cc2e148c-a12d-4495-b412-51aa11e6c36e tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:13.808471 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-cc2e148c-a12d-4495-b412-51aa11e6c36e tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:13.815986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-cc2e148c-a12d-4495-b412-51aa11e6c36e tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.223901 Jun 03 15:27:13.816569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 34/64] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:13 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:13.936989 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-80144bf8-f3ce-4033-b231-286c921c3d49 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:13.937936 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-80144bf8-f3ce-4033-b231-286c921c3d49 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:13.944265 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80144bf8-f3ce-4033-b231-286c921c3d49 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:13.944899 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80144bf8-f3ce-4033-b231-286c921c3d49 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:13.946087 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80144bf8-f3ce-4033-b231-286c921c3d49 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:13.946316 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80144bf8-f3ce-4033-b231-286c921c3d49 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:13.963012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=100 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:14.014040 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-80144bf8-f3ce-4033-b231-286c921c3d49 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:14.024007 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-80144bf8-f3ce-4033-b231-286c921c3d49 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1280 microversion: 2.1 time: 0.090105 Jun 03 15:27:14.024835 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 31/65] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:13 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:14.324973 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8efce18e-617a-47d9-b1d7-52d6a9d0a403 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:14.326018 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8efce18e-617a-47d9-b1d7-52d6a9d0a403 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:14.337971 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8efce18e-617a-47d9-b1d7-52d6a9d0a403 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:14.339049 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8efce18e-617a-47d9-b1d7-52d6a9d0a403 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:14.340345 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8efce18e-617a-47d9-b1d7-52d6a9d0a403 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:14.341071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8efce18e-617a-47d9-b1d7-52d6a9d0a403 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:14.414954 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4e05f13c-f012-4a0e-85d3-cf1e061b4571 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:14.415672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4e05f13c-f012-4a0e-85d3-cf1e061b4571 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:14.425940 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e05f13c-f012-4a0e-85d3-cf1e061b4571 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:14.426783 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e05f13c-f012-4a0e-85d3-cf1e061b4571 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:14.427297 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e05f13c-f012-4a0e-85d3-cf1e061b4571 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:14.427732 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e05f13c-f012-4a0e-85d3-cf1e061b4571 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:14.437699 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8efce18e-617a-47d9-b1d7-52d6a9d0a403 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:14.446326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8efce18e-617a-47d9-b1d7-52d6a9d0a403 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:14.448696 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8efce18e-617a-47d9-b1d7-52d6a9d0a403 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:14.449972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8efce18e-617a-47d9-b1d7-52d6a9d0a403 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1338 microversion: 2.20 time: 0.129195 Jun 03 15:27:14.461685 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 35/66] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:14 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1338 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:14.592493 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4e05f13c-f012-4a0e-85d3-cf1e061b4571 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:14.600580 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-23bec110-864f-4a3e-ac8c-09b658485fe2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:14.601251 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-23bec110-864f-4a3e-ac8c-09b658485fe2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:14.603721 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4e05f13c-f012-4a0e-85d3-cf1e061b4571 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.192938 Jun 03 15:27:14.604311 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 32/67] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:14 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:14.617030 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23bec110-864f-4a3e-ac8c-09b658485fe2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:14.617637 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23bec110-864f-4a3e-ac8c-09b658485fe2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:14.618982 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23bec110-864f-4a3e-ac8c-09b658485fe2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:14.619483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23bec110-864f-4a3e-ac8c-09b658485fe2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:14.774463 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-23bec110-864f-4a3e-ac8c-09b658485fe2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:14.783613 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-23bec110-864f-4a3e-ac8c-09b658485fe2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.186942 Jun 03 15:27:14.784185 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 36/68] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:14 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:14.833730 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-eb42dd8d-142d-441f-a5a3-d79900968d7a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:14.834185 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-eb42dd8d-142d-441f-a5a3-d79900968d7a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:14.841404 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb42dd8d-142d-441f-a5a3-d79900968d7a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:14.841917 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb42dd8d-142d-441f-a5a3-d79900968d7a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:14.842916 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb42dd8d-142d-441f-a5a3-d79900968d7a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:14.843344 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb42dd8d-142d-441f-a5a3-d79900968d7a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:15.042384 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4968f1ec-5eaf-4021-8612-5561a387a026 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:15.043256 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4968f1ec-5eaf-4021-8612-5561a387a026 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:15.053202 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4968f1ec-5eaf-4021-8612-5561a387a026 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:15.053924 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4968f1ec-5eaf-4021-8612-5561a387a026 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:15.058038 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4968f1ec-5eaf-4021-8612-5561a387a026 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:15.058746 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4968f1ec-5eaf-4021-8612-5561a387a026 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:15.281319 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4968f1ec-5eaf-4021-8612-5561a387a026 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:15.293444 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4968f1ec-5eaf-4021-8612-5561a387a026 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1280 microversion: 2.1 time: 0.255660 Jun 03 15:27:15.294329 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 37/69] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:15 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1280 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:15.407976 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-eb42dd8d-142d-441f-a5a3-d79900968d7a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:15.418946 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-eb42dd8d-142d-441f-a5a3-d79900968d7a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.589433 Jun 03 15:27:15.419904 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 33/70] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:14 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:15.470179 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-62961903-e944-42c8-8e6b-fcaa0d84111e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:15.471903 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-62961903-e944-42c8-8e6b-fcaa0d84111e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:15.483575 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-62961903-e944-42c8-8e6b-fcaa0d84111e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:15.484519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-62961903-e944-42c8-8e6b-fcaa0d84111e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:15.485959 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-62961903-e944-42c8-8e6b-fcaa0d84111e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:15.486756 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-62961903-e944-42c8-8e6b-fcaa0d84111e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:15.623486 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e821ca41-9430-4fd3-8aed-748811cfd85c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:15.626052 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e821ca41-9430-4fd3-8aed-748811cfd85c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:15.639346 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e821ca41-9430-4fd3-8aed-748811cfd85c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:15.639988 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e821ca41-9430-4fd3-8aed-748811cfd85c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:15.641813 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e821ca41-9430-4fd3-8aed-748811cfd85c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:15.652824 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-62961903-e944-42c8-8e6b-fcaa0d84111e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:15.661754 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e821ca41-9430-4fd3-8aed-748811cfd85c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:15.680618 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-62961903-e944-42c8-8e6b-fcaa0d84111e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:15.689625 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-62961903-e944-42c8-8e6b-fcaa0d84111e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:15.692079 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-62961903-e944-42c8-8e6b-fcaa0d84111e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1338 microversion: 2.20 time: 0.226431 Jun 03 15:27:15.692688 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 38/71] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:15 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1338 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:15.805199 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-98e9f53f-ac50-4c55-ae60-64d1f442680f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:15.806267 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-98e9f53f-ac50-4c55-ae60-64d1f442680f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:15.824753 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98e9f53f-ac50-4c55-ae60-64d1f442680f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:15.825537 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98e9f53f-ac50-4c55-ae60-64d1f442680f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:15.827623 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98e9f53f-ac50-4c55-ae60-64d1f442680f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:15.828244 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98e9f53f-ac50-4c55-ae60-64d1f442680f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:15.910059 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=100 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:16.230201 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e821ca41-9430-4fd3-8aed-748811cfd85c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:16.245088 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e821ca41-9430-4fd3-8aed-748811cfd85c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.628841 Jun 03 15:27:16.255585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 34/72] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:15 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:16.311580 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-81b1a118-17d1-42d2-ae3b-98f7ffebbcf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:16.312203 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-81b1a118-17d1-42d2-ae3b-98f7ffebbcf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:16.322500 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-81b1a118-17d1-42d2-ae3b-98f7ffebbcf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:16.323908 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-81b1a118-17d1-42d2-ae3b-98f7ffebbcf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:16.332987 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-81b1a118-17d1-42d2-ae3b-98f7ffebbcf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:16.333626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-81b1a118-17d1-42d2-ae3b-98f7ffebbcf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:16.516004 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-98e9f53f-ac50-4c55-ae60-64d1f442680f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:16.525999 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-98e9f53f-ac50-4c55-ae60-64d1f442680f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.728481 Jun 03 15:27:16.526606 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 39/73] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:15 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:16.528972 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-81b1a118-17d1-42d2-ae3b-98f7ffebbcf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:16.533266 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d7f3be1c-317b-42ca-9beb-f7ae322a49ce tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:16.534105 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d7f3be1c-317b-42ca-9beb-f7ae322a49ce tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:16.542066 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d7f3be1c-317b-42ca-9beb-f7ae322a49ce tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:16.542625 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d7f3be1c-317b-42ca-9beb-f7ae322a49ce tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:16.543424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d7f3be1c-317b-42ca-9beb-f7ae322a49ce tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:16.544698 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d7f3be1c-317b-42ca-9beb-f7ae322a49ce tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:16.549763 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-81b1a118-17d1-42d2-ae3b-98f7ffebbcf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1280 microversion: 2.1 time: 0.241948 Jun 03 15:27:16.560032 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 35/74] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:16 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:16.710432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-764f9f76-ea94-4453-b912-787b09da7e95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:16.711872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-764f9f76-ea94-4453-b912-787b09da7e95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:16.718440 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-764f9f76-ea94-4453-b912-787b09da7e95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:16.719500 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-764f9f76-ea94-4453-b912-787b09da7e95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:16.720742 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-764f9f76-ea94-4453-b912-787b09da7e95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:16.721402 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-764f9f76-ea94-4453-b912-787b09da7e95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:16.812777 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d7f3be1c-317b-42ca-9beb-f7ae322a49ce tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:16.824553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d7f3be1c-317b-42ca-9beb-f7ae322a49ce tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1315 microversion: 2.1 time: 0.296438 Jun 03 15:27:16.826046 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 40/75] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:16 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:16.872511 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-764f9f76-ea94-4453-b912-787b09da7e95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:16.893535 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-764f9f76-ea94-4453-b912-787b09da7e95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:16.899675 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-764f9f76-ea94-4453-b912-787b09da7e95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:16.900036 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-764f9f76-ea94-4453-b912-787b09da7e95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1338 microversion: 2.20 time: 0.193469 Jun 03 15:27:16.910719 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 36/76] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:16 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1338 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:27:17.275377 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b2e4b102-9edc-46e3-8b00-ffef566264d2 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:17.276359 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b2e4b102-9edc-46e3-8b00-ffef566264d2 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:17.293690 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b2e4b102-9edc-46e3-8b00-ffef566264d2 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:17.294341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b2e4b102-9edc-46e3-8b00-ffef566264d2 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:17.296154 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b2e4b102-9edc-46e3-8b00-ffef566264d2 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:17.297908 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b2e4b102-9edc-46e3-8b00-ffef566264d2 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:17.388952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=6 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:17.489189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=22 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:17.546168 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3981dd31-fb51-448d-bf03-0800fb9172d6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:17.547206 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3981dd31-fb51-448d-bf03-0800fb9172d6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:17.565990 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3981dd31-fb51-448d-bf03-0800fb9172d6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:17.566724 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3981dd31-fb51-448d-bf03-0800fb9172d6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:17.568390 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3981dd31-fb51-448d-bf03-0800fb9172d6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:17.569383 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3981dd31-fb51-448d-bf03-0800fb9172d6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:17.739453 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b2e4b102-9edc-46e3-8b00-ffef566264d2 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:17.751708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b2e4b102-9edc-46e3-8b00-ffef566264d2 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.482114 Jun 03 15:27:17.752348 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 41/77] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:17 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:17.779850 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e016be02-3e90-42c8-9de7-0e1f53f89078 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:17.782813 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e016be02-3e90-42c8-9de7-0e1f53f89078 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:17.806939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e016be02-3e90-42c8-9de7-0e1f53f89078 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:17.807400 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e016be02-3e90-42c8-9de7-0e1f53f89078 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:17.808511 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e016be02-3e90-42c8-9de7-0e1f53f89078 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:17.809063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e016be02-3e90-42c8-9de7-0e1f53f89078 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:18.322897 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3981dd31-fb51-448d-bf03-0800fb9172d6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:18.362035 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3981dd31-fb51-448d-bf03-0800fb9172d6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.822140 Jun 03 15:27:18.366983 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 37/78] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:17 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:18.379204 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-13cfd3a3-2f1f-4be0-bc77-4d356c92ed9c req-722c6497-c69f-4a12-a39c-d397337941c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce808322-3f17-4d8f-8d33-909ecba99d7a", "tag": "4191cebd-3cce-492d-9aee-68a1dfd6dc5f"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:18.412731 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-13cfd3a3-2f1f-4be0-bc77-4d356c92ed9c req-722c6497-c69f-4a12-a39c-d397337941c4 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:18.413180 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-13cfd3a3-2f1f-4be0-bc77-4d356c92ed9c req-722c6497-c69f-4a12-a39c-d397337941c4 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:18.459241 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-13cfd3a3-2f1f-4be0-bc77-4d356c92ed9c req-722c6497-c69f-4a12-a39c-d397337941c4 service nova] Creating event network-changed:4191cebd-3cce-492d-9aee-68a1dfd6dc5f for instance ce808322-3f17-4d8f-8d33-909ecba99d7a on hv-cinder-83124 Jun 03 15:27:18.460014 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-13cfd3a3-2f1f-4be0-bc77-4d356c92ed9c req-722c6497-c69f-4a12-a39c-d397337941c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117805) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 15:27:18.462666 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-202a803e-0ed8-4e6b-a578-eefe15a22cca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:18.463317 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-202a803e-0ed8-4e6b-a578-eefe15a22cca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:18.464391 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-202a803e-0ed8-4e6b-a578-eefe15a22cca None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:18.464960 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-202a803e-0ed8-4e6b-a578-eefe15a22cca None None] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:18.497945 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.compute.rpcapi [None req-202a803e-0ed8-4e6b-a578-eefe15a22cca None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 15:27:18.503960 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-202a803e-0ed8-4e6b-a578-eefe15a22cca None None] Releasing lock "compute-rpcapi-router" {{(pid=117805) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 15:27:18.562768 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-202a803e-0ed8-4e6b-a578-eefe15a22cca None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194067 Jun 03 15:27:18.563651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 38/79] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:18.569612 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3d981ed3-6eac-4b21-bac5-9d59d7db373d tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:18.571432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3d981ed3-6eac-4b21-bac5-9d59d7db373d tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:18.586240 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d981ed3-6eac-4b21-bac5-9d59d7db373d tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:18.587738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d981ed3-6eac-4b21-bac5-9d59d7db373d tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:18.592884 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d981ed3-6eac-4b21-bac5-9d59d7db373d tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:18.592884 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d981ed3-6eac-4b21-bac5-9d59d7db373d tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:18.593266 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e016be02-3e90-42c8-9de7-0e1f53f89078 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:18.616455 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e016be02-3e90-42c8-9de7-0e1f53f89078 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.842255 Jun 03 15:27:18.625883 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 42/80] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:17 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:18.650355 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-520c0319-9b4d-4f96-a95d-10cd4522cea7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:18.655323 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-520c0319-9b4d-4f96-a95d-10cd4522cea7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:18.676051 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-520c0319-9b4d-4f96-a95d-10cd4522cea7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:18.677899 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-520c0319-9b4d-4f96-a95d-10cd4522cea7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:18.683172 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-520c0319-9b4d-4f96-a95d-10cd4522cea7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:18.686607 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-520c0319-9b4d-4f96-a95d-10cd4522cea7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:18.978370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-520c0319-9b4d-4f96-a95d-10cd4522cea7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:18.991727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-520c0319-9b4d-4f96-a95d-10cd4522cea7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:18.993433 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-520c0319-9b4d-4f96-a95d-10cd4522cea7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:18.994770 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-520c0319-9b4d-4f96-a95d-10cd4522cea7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.355121 Jun 03 15:27:18.995684 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 43/81] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:18 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:19.042295 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3d981ed3-6eac-4b21-bac5-9d59d7db373d tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:19.059246 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3d981ed3-6eac-4b21-bac5-9d59d7db373d tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1501 microversion: 2.1 time: 0.492788 Jun 03 15:27:19.062787 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 39/82] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:18 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1501 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:19.077837 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-07371f1d-edf4-4df1-931e-4b638db5198f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:19.082906 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-07371f1d-edf4-4df1-931e-4b638db5198f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:19.113414 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07371f1d-edf4-4df1-931e-4b638db5198f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:19.114677 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07371f1d-edf4-4df1-931e-4b638db5198f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:19.117312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07371f1d-edf4-4df1-931e-4b638db5198f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:19.118484 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07371f1d-edf4-4df1-931e-4b638db5198f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:19.226770 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-fc15acdc-3f14-4ebf-aeeb-c21a4244fc03 req-bdc3d120-33f0-4e13-a90d-a102e303529b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9be206f-1554-46fe-9fa7-581d2d394865", "tag": "67597138-621c-43e8-af88-f2fa1bf44d03"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:19.236437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-fc15acdc-3f14-4ebf-aeeb-c21a4244fc03 req-bdc3d120-33f0-4e13-a90d-a102e303529b service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:19.237124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-fc15acdc-3f14-4ebf-aeeb-c21a4244fc03 req-bdc3d120-33f0-4e13-a90d-a102e303529b service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:19.249662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-fc15acdc-3f14-4ebf-aeeb-c21a4244fc03 req-bdc3d120-33f0-4e13-a90d-a102e303529b service nova] Creating event network-changed:67597138-621c-43e8-af88-f2fa1bf44d03 for instance f9be206f-1554-46fe-9fa7-581d2d394865 on hv-cinder-83124 Jun 03 15:27:19.255241 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-fc15acdc-3f14-4ebf-aeeb-c21a4244fc03 req-bdc3d120-33f0-4e13-a90d-a102e303529b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258114 Jun 03 15:27:19.256135 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 44/83] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:19.386644 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-01d6ce12-bf7d-43af-952f-dfb04a7e82f1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:19.387668 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-01d6ce12-bf7d-43af-952f-dfb04a7e82f1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:19.398452 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-01d6ce12-bf7d-43af-952f-dfb04a7e82f1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:19.399116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-01d6ce12-bf7d-43af-952f-dfb04a7e82f1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:19.400408 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-01d6ce12-bf7d-43af-952f-dfb04a7e82f1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:19.401965 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-01d6ce12-bf7d-43af-952f-dfb04a7e82f1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:19.475389 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=22 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:19.692240 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-01d6ce12-bf7d-43af-952f-dfb04a7e82f1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:19.703507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-01d6ce12-bf7d-43af-952f-dfb04a7e82f1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.326252 Jun 03 15:27:19.716142 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 45/84] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:19 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:19.733954 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8abecc6e-640e-4479-a15e-2d5c6215ad58 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:19.734424 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-07371f1d-edf4-4df1-931e-4b638db5198f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:19.738434 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8abecc6e-640e-4479-a15e-2d5c6215ad58 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:19.743315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-07371f1d-edf4-4df1-931e-4b638db5198f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.677542 Jun 03 15:27:19.751135 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 40/85] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:19 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:19.760365 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8abecc6e-640e-4479-a15e-2d5c6215ad58 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:19.760806 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8abecc6e-640e-4479-a15e-2d5c6215ad58 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:19.761761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8abecc6e-640e-4479-a15e-2d5c6215ad58 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:19.762391 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8abecc6e-640e-4479-a15e-2d5c6215ad58 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:20.022172 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-75e190a8-2283-4171-86bc-2d620edcf0ce tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:20.023617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-75e190a8-2283-4171-86bc-2d620edcf0ce tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:20.036120 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-75e190a8-2283-4171-86bc-2d620edcf0ce tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:20.036565 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-75e190a8-2283-4171-86bc-2d620edcf0ce tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:20.044016 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-75e190a8-2283-4171-86bc-2d620edcf0ce tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:20.051543 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-75e190a8-2283-4171-86bc-2d620edcf0ce tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:20.063163 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8abecc6e-640e-4479-a15e-2d5c6215ad58 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:20.074603 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8abecc6e-640e-4479-a15e-2d5c6215ad58 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.357934 Jun 03 15:27:20.075903 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 46/86] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:19 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:20.417801 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-75e190a8-2283-4171-86bc-2d620edcf0ce tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:20.425994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-75e190a8-2283-4171-86bc-2d620edcf0ce tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:20.427659 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-75e190a8-2283-4171-86bc-2d620edcf0ce tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:20.428843 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-75e190a8-2283-4171-86bc-2d620edcf0ce tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.410586 Jun 03 15:27:20.429443 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 41/87] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:20 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:27:20.595724 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-32f04cae-c35a-44f1-ad93-c5e6e0d35569 req-1d113ccb-e6a5-4e4c-b0b1-5b5211d5fbeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758b095c-6da9-4d53-abba-6a13a7c50904", "tag": "a6777d99-9001-40c7-8dc0-bac5ca7c5efe"}, {"name": "network-changed", "server_uuid": "e123dc0c-78c6-44ce-b847-927843a3751c", "tag": "d065a51d-4c7e-482f-87f7-74c4d679a6c1"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:20.605073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-32f04cae-c35a-44f1-ad93-c5e6e0d35569 req-1d113ccb-e6a5-4e4c-b0b1-5b5211d5fbeb service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:20.605384 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-32f04cae-c35a-44f1-ad93-c5e6e0d35569 req-1d113ccb-e6a5-4e4c-b0b1-5b5211d5fbeb service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:20.621786 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-32f04cae-c35a-44f1-ad93-c5e6e0d35569 req-1d113ccb-e6a5-4e4c-b0b1-5b5211d5fbeb service nova] Creating event network-changed:a6777d99-9001-40c7-8dc0-bac5ca7c5efe for instance 758b095c-6da9-4d53-abba-6a13a7c50904 on hv-cinder-83124 Jun 03 15:27:20.622758 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-32f04cae-c35a-44f1-ad93-c5e6e0d35569 req-1d113ccb-e6a5-4e4c-b0b1-5b5211d5fbeb service nova] Creating event network-changed:d065a51d-4c7e-482f-87f7-74c4d679a6c1 for instance e123dc0c-78c6-44ce-b847-927843a3751c on hv-cinder-83124 Jun 03 15:27:20.629307 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-32f04cae-c35a-44f1-ad93-c5e6e0d35569 req-1d113ccb-e6a5-4e4c-b0b1-5b5211d5fbeb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037141 Jun 03 15:27:20.629941 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 47/88] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:20.720351 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-80f8f2b1-3d2c-4697-88e8-64ffb217d8cf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:20.720958 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-80f8f2b1-3d2c-4697-88e8-64ffb217d8cf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:20.727247 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80f8f2b1-3d2c-4697-88e8-64ffb217d8cf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:20.727705 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80f8f2b1-3d2c-4697-88e8-64ffb217d8cf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:20.728483 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80f8f2b1-3d2c-4697-88e8-64ffb217d8cf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:20.728925 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80f8f2b1-3d2c-4697-88e8-64ffb217d8cf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:20.769225 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-249533e8-914f-444a-97e7-4b3ac8367b5d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:20.770098 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-249533e8-914f-444a-97e7-4b3ac8367b5d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:20.778112 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-249533e8-914f-444a-97e7-4b3ac8367b5d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:20.780230 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-249533e8-914f-444a-97e7-4b3ac8367b5d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:20.781284 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-249533e8-914f-444a-97e7-4b3ac8367b5d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:20.781988 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-249533e8-914f-444a-97e7-4b3ac8367b5d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:20.890367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-80f8f2b1-3d2c-4697-88e8-64ffb217d8cf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:20.899923 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-80f8f2b1-3d2c-4697-88e8-64ffb217d8cf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.183429 Jun 03 15:27:20.900499 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 42/89] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:20 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:20.962669 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-249533e8-914f-444a-97e7-4b3ac8367b5d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:20.970779 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-249533e8-914f-444a-97e7-4b3ac8367b5d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.206021 Jun 03 15:27:20.971352 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 48/90] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:20 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:21.091649 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-42c76277-25d0-41b5-abca-b4a1480d9d85 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:21.092171 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-42c76277-25d0-41b5-abca-b4a1480d9d85 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:21.098282 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-42c76277-25d0-41b5-abca-b4a1480d9d85 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:21.098778 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-42c76277-25d0-41b5-abca-b4a1480d9d85 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:21.100526 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-42c76277-25d0-41b5-abca-b4a1480d9d85 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:21.100972 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-42c76277-25d0-41b5-abca-b4a1480d9d85 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:21.236443 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-42c76277-25d0-41b5-abca-b4a1480d9d85 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:21.244459 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-42c76277-25d0-41b5-abca-b4a1480d9d85 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.156696 Jun 03 15:27:21.245017 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 43/91] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:21 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:21.271282 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-f4bc8b2c-f2f1-4e6f-ac48-a9b771b19e52 req-aa93ab3d-49b1-4ac0-bcad-baf5fe118fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3", "tag": "d4a71b7c-b829-4818-a730-8eda807ebe70"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:21.280270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-f4bc8b2c-f2f1-4e6f-ac48-a9b771b19e52 req-aa93ab3d-49b1-4ac0-bcad-baf5fe118fde service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:21.280719 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-f4bc8b2c-f2f1-4e6f-ac48-a9b771b19e52 req-aa93ab3d-49b1-4ac0-bcad-baf5fe118fde service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:21.292251 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-f4bc8b2c-f2f1-4e6f-ac48-a9b771b19e52 req-aa93ab3d-49b1-4ac0-bcad-baf5fe118fde service nova] Creating event network-changed:d4a71b7c-b829-4818-a730-8eda807ebe70 for instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 on hv-cinder-83124 Jun 03 15:27:21.297044 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-f4bc8b2c-f2f1-4e6f-ac48-a9b771b19e52 req-aa93ab3d-49b1-4ac0-bcad-baf5fe118fde service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029304 Jun 03 15:27:21.297937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 49/92] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:21.450757 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3afc45ed-b435-46e7-a81d-0520c2576743 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:21.451299 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3afc45ed-b435-46e7-a81d-0520c2576743 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:21.460151 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3afc45ed-b435-46e7-a81d-0520c2576743 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:21.461817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3afc45ed-b435-46e7-a81d-0520c2576743 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:21.463125 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3afc45ed-b435-46e7-a81d-0520c2576743 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:21.464456 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3afc45ed-b435-46e7-a81d-0520c2576743 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:21.927272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-94480f0c-35b5-4108-9975-84f372f1c106 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:21.928972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-94480f0c-35b5-4108-9975-84f372f1c106 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:21.943423 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-94480f0c-35b5-4108-9975-84f372f1c106 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:21.945109 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-94480f0c-35b5-4108-9975-84f372f1c106 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:21.947498 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-94480f0c-35b5-4108-9975-84f372f1c106 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:21.948786 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-94480f0c-35b5-4108-9975-84f372f1c106 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:22.211971 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3afc45ed-b435-46e7-a81d-0520c2576743 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:22.229200 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3afc45ed-b435-46e7-a81d-0520c2576743 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:22.236167 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3afc45ed-b435-46e7-a81d-0520c2576743 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:22.238993 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3afc45ed-b435-46e7-a81d-0520c2576743 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.791626 Jun 03 15:27:22.239787 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 44/93] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:21 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:27:22.251425 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7fc367a3-7f3e-4210-8abc-7db51df3882a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14d07dfd-67e9-4836-9208-e49cf02d8261"}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:22.262964 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7fc367a3-7f3e-4210-8abc-7db51df3882a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:22.276200 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7fc367a3-7f3e-4210-8abc-7db51df3882a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:22.279065 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7fc367a3-7f3e-4210-8abc-7db51df3882a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:22.281055 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7fc367a3-7f3e-4210-8abc-7db51df3882a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:22.285280 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7fc367a3-7f3e-4210-8abc-7db51df3882a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:22.296183 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-94480f0c-35b5-4108-9975-84f372f1c106 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:22.314202 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-94480f0c-35b5-4108-9975-84f372f1c106 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.395522 Jun 03 15:27:22.317532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 50/94] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:21 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:22.328174 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9828317e-f694-46aa-811e-9f6b0bf6a9d4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:22.332788 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9828317e-f694-46aa-811e-9f6b0bf6a9d4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:22.341581 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9828317e-f694-46aa-811e-9f6b0bf6a9d4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:22.342276 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9828317e-f694-46aa-811e-9f6b0bf6a9d4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:22.343564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9828317e-f694-46aa-811e-9f6b0bf6a9d4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:22.344256 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9828317e-f694-46aa-811e-9f6b0bf6a9d4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:22.754946 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9828317e-f694-46aa-811e-9f6b0bf6a9d4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:22.763250 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9828317e-f694-46aa-811e-9f6b0bf6a9d4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.444139 Jun 03 15:27:22.763896 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 51/95] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:22 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:22.768503 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5607352a-fe5c-4cdf-8bfb-5f8e77ab161a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:22.769196 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5607352a-fe5c-4cdf-8bfb-5f8e77ab161a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:22.775717 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5607352a-fe5c-4cdf-8bfb-5f8e77ab161a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:22.776170 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5607352a-fe5c-4cdf-8bfb-5f8e77ab161a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:22.776942 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5607352a-fe5c-4cdf-8bfb-5f8e77ab161a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:22.777389 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5607352a-fe5c-4cdf-8bfb-5f8e77ab161a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:22.916082 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5607352a-fe5c-4cdf-8bfb-5f8e77ab161a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:22.923800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5607352a-fe5c-4cdf-8bfb-5f8e77ab161a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.158920 Jun 03 15:27:22.924365 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 52/96] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:22 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:23.258701 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5ebcbe6a-abb9-4e2f-bf30-caaff3dca03c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:23.259315 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5ebcbe6a-abb9-4e2f-bf30-caaff3dca03c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:23.265881 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5ebcbe6a-abb9-4e2f-bf30-caaff3dca03c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:23.266340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5ebcbe6a-abb9-4e2f-bf30-caaff3dca03c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:23.267154 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5ebcbe6a-abb9-4e2f-bf30-caaff3dca03c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:23.267591 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5ebcbe6a-abb9-4e2f-bf30-caaff3dca03c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:23.411724 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5ebcbe6a-abb9-4e2f-bf30-caaff3dca03c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:23.420678 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5ebcbe6a-abb9-4e2f-bf30-caaff3dca03c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:23.422510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5ebcbe6a-abb9-4e2f-bf30-caaff3dca03c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:23.424029 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5ebcbe6a-abb9-4e2f-bf30-caaff3dca03c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.170373 Jun 03 15:27:23.424596 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 53/97] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:23 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:27:23.440575 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-82fbe35f-aae0-444b-a47f-d7f9f1989bb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:23.441446 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-82fbe35f-aae0-444b-a47f-d7f9f1989bb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:23.450459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-82fbe35f-aae0-444b-a47f-d7f9f1989bb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:23.450988 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-82fbe35f-aae0-444b-a47f-d7f9f1989bb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:23.464545 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-82fbe35f-aae0-444b-a47f-d7f9f1989bb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:23.466924 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-82fbe35f-aae0-444b-a47f-d7f9f1989bb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:23.709087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-82fbe35f-aae0-444b-a47f-d7f9f1989bb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:23.718180 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-82fbe35f-aae0-444b-a47f-d7f9f1989bb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.292416 Jun 03 15:27:23.718947 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 54/98] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:23 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:23.782320 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c5105b52-acaa-4df2-a906-4cb563cf2e90 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:23.783165 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c5105b52-acaa-4df2-a906-4cb563cf2e90 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:23.785247 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:23.790813 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c5105b52-acaa-4df2-a906-4cb563cf2e90 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:23.791267 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c5105b52-acaa-4df2-a906-4cb563cf2e90 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:23.792280 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c5105b52-acaa-4df2-a906-4cb563cf2e90 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:23.792862 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c5105b52-acaa-4df2-a906-4cb563cf2e90 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:24.165548 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c5105b52-acaa-4df2-a906-4cb563cf2e90 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:24.173414 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c5105b52-acaa-4df2-a906-4cb563cf2e90 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.395619 Jun 03 15:27:24.174020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 55/99] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:23 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:24.179819 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4cd38c05-13f8-487c-ad80-c0c621448637 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:24.180569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4cd38c05-13f8-487c-ad80-c0c621448637 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:24.188202 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4cd38c05-13f8-487c-ad80-c0c621448637 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:24.188655 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4cd38c05-13f8-487c-ad80-c0c621448637 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:24.189505 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4cd38c05-13f8-487c-ad80-c0c621448637 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:24.189951 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4cd38c05-13f8-487c-ad80-c0c621448637 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:24.339192 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4cd38c05-13f8-487c-ad80-c0c621448637 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:24.348774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4cd38c05-13f8-487c-ad80-c0c621448637 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.173054 Jun 03 15:27:24.349915 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 56/100] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:24 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:24.442514 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f289cc14-3895-4344-a387-dea137fb8873 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:24.447203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f289cc14-3895-4344-a387-dea137fb8873 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:24.449550 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f289cc14-3895-4344-a387-dea137fb8873 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:24.450119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f289cc14-3895-4344-a387-dea137fb8873 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:24.452565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f289cc14-3895-4344-a387-dea137fb8873 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:24.453032 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f289cc14-3895-4344-a387-dea137fb8873 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:24.602181 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f289cc14-3895-4344-a387-dea137fb8873 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:24.605697 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=100 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:24.614187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f289cc14-3895-4344-a387-dea137fb8873 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:24.615935 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f289cc14-3895-4344-a387-dea137fb8873 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:24.617745 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f289cc14-3895-4344-a387-dea137fb8873 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.179224 Jun 03 15:27:24.618347 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 57/101] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:24 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:27:24.735879 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c54a7c39-4a11-4f06-94d4-8f9dfa470292 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:24.736618 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c54a7c39-4a11-4f06-94d4-8f9dfa470292 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:24.744740 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c54a7c39-4a11-4f06-94d4-8f9dfa470292 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:24.745203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c54a7c39-4a11-4f06-94d4-8f9dfa470292 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:24.746640 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c54a7c39-4a11-4f06-94d4-8f9dfa470292 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:24.747677 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c54a7c39-4a11-4f06-94d4-8f9dfa470292 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:24.954264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c54a7c39-4a11-4f06-94d4-8f9dfa470292 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:24.962306 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c54a7c39-4a11-4f06-94d4-8f9dfa470292 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.230831 Jun 03 15:27:24.962908 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 58/102] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:24 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:25.192065 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2db89c21-e08c-481a-a8bd-b59e763d84ba tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:25.192702 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2db89c21-e08c-481a-a8bd-b59e763d84ba tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:25.200892 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2db89c21-e08c-481a-a8bd-b59e763d84ba tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:25.201407 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2db89c21-e08c-481a-a8bd-b59e763d84ba tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:25.202414 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2db89c21-e08c-481a-a8bd-b59e763d84ba tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:25.202992 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2db89c21-e08c-481a-a8bd-b59e763d84ba tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:25.354908 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2db89c21-e08c-481a-a8bd-b59e763d84ba tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:25.363553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2db89c21-e08c-481a-a8bd-b59e763d84ba tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.175297 Jun 03 15:27:25.364126 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 59/103] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:25 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:25.369333 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-628222b1-db3f-4e74-9ad2-34c183bded52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:25.369935 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-628222b1-db3f-4e74-9ad2-34c183bded52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:25.376621 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-628222b1-db3f-4e74-9ad2-34c183bded52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:25.377073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-628222b1-db3f-4e74-9ad2-34c183bded52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:25.377850 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-628222b1-db3f-4e74-9ad2-34c183bded52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:25.378284 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-628222b1-db3f-4e74-9ad2-34c183bded52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:25.534090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-628222b1-db3f-4e74-9ad2-34c183bded52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:25.542892 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-628222b1-db3f-4e74-9ad2-34c183bded52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.177618 Jun 03 15:27:25.543742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 60/104] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:25 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:25.638206 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-fdab22e9-7c97-4a25-8f47-43a5b0fd62b6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:25.638950 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-fdab22e9-7c97-4a25-8f47-43a5b0fd62b6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:25.646165 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fdab22e9-7c97-4a25-8f47-43a5b0fd62b6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:25.647246 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fdab22e9-7c97-4a25-8f47-43a5b0fd62b6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:25.651388 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fdab22e9-7c97-4a25-8f47-43a5b0fd62b6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:25.651388 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fdab22e9-7c97-4a25-8f47-43a5b0fd62b6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:25.791780 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-fdab22e9-7c97-4a25-8f47-43a5b0fd62b6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:25.800084 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-fdab22e9-7c97-4a25-8f47-43a5b0fd62b6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:25.801683 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-fdab22e9-7c97-4a25-8f47-43a5b0fd62b6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:25.802922 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-fdab22e9-7c97-4a25-8f47-43a5b0fd62b6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.168566 Jun 03 15:27:25.803561 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 61/105] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:25 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:25.979681 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-325bc111-b343-4cb1-844f-1bea15871f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:25.980289 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-325bc111-b343-4cb1-844f-1bea15871f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:25.986452 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-325bc111-b343-4cb1-844f-1bea15871f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:25.986935 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-325bc111-b343-4cb1-844f-1bea15871f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:25.987699 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-325bc111-b343-4cb1-844f-1bea15871f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:25.988118 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-325bc111-b343-4cb1-844f-1bea15871f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:26.135896 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-325bc111-b343-4cb1-844f-1bea15871f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:26.143566 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-325bc111-b343-4cb1-844f-1bea15871f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.168130 Jun 03 15:27:26.144125 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 62/106] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:25 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:26.386797 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-10033513-e312-4136-8683-38340892a65b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:26.387425 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-10033513-e312-4136-8683-38340892a65b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:26.397458 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-10033513-e312-4136-8683-38340892a65b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:26.398673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-10033513-e312-4136-8683-38340892a65b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:26.399461 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-10033513-e312-4136-8683-38340892a65b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:26.400127 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-10033513-e312-4136-8683-38340892a65b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:26.584101 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-10033513-e312-4136-8683-38340892a65b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:26.593276 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-10033513-e312-4136-8683-38340892a65b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.211667 Jun 03 15:27:26.594007 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 63/107] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:26 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:26.599210 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6e68ca32-95bf-411f-956a-a66b17623fab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:26.599936 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6e68ca32-95bf-411f-956a-a66b17623fab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:26.606374 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e68ca32-95bf-411f-956a-a66b17623fab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:26.607065 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e68ca32-95bf-411f-956a-a66b17623fab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:26.607937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e68ca32-95bf-411f-956a-a66b17623fab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:26.608470 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e68ca32-95bf-411f-956a-a66b17623fab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:26.790844 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6e68ca32-95bf-411f-956a-a66b17623fab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:26.799073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6e68ca32-95bf-411f-956a-a66b17623fab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.203661 Jun 03 15:27:26.799851 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 64/108] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:26 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:26.822750 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ff69fe6c-5cb1-4ed7-b4db-203322e3f36f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:26.823325 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ff69fe6c-5cb1-4ed7-b4db-203322e3f36f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:26.830268 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ff69fe6c-5cb1-4ed7-b4db-203322e3f36f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:26.830759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ff69fe6c-5cb1-4ed7-b4db-203322e3f36f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:26.831533 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ff69fe6c-5cb1-4ed7-b4db-203322e3f36f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:26.831971 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ff69fe6c-5cb1-4ed7-b4db-203322e3f36f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:26.974833 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ff69fe6c-5cb1-4ed7-b4db-203322e3f36f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:26.984371 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ff69fe6c-5cb1-4ed7-b4db-203322e3f36f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:26.986018 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ff69fe6c-5cb1-4ed7-b4db-203322e3f36f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:26.987205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ff69fe6c-5cb1-4ed7-b4db-203322e3f36f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.169299 Jun 03 15:27:26.998163 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 65/109] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:26 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:27:27.161242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1efcbf1d-81c1-4b0b-9c9c-6ee4aa13845b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:27.161948 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1efcbf1d-81c1-4b0b-9c9c-6ee4aa13845b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:27.169671 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1efcbf1d-81c1-4b0b-9c9c-6ee4aa13845b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:27.170446 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1efcbf1d-81c1-4b0b-9c9c-6ee4aa13845b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:27.171339 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1efcbf1d-81c1-4b0b-9c9c-6ee4aa13845b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:27.171859 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1efcbf1d-81c1-4b0b-9c9c-6ee4aa13845b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:27.314965 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1efcbf1d-81c1-4b0b-9c9c-6ee4aa13845b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:27.323251 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1efcbf1d-81c1-4b0b-9c9c-6ee4aa13845b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.165506 Jun 03 15:27:27.323970 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 66/110] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:27 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:27.611560 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3aeb1e8f-dc74-483e-9ac7-b3ca11324fb9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:27.612428 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3aeb1e8f-dc74-483e-9ac7-b3ca11324fb9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:27.619470 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3aeb1e8f-dc74-483e-9ac7-b3ca11324fb9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:27.620174 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3aeb1e8f-dc74-483e-9ac7-b3ca11324fb9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:27.621316 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3aeb1e8f-dc74-483e-9ac7-b3ca11324fb9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:27.621857 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3aeb1e8f-dc74-483e-9ac7-b3ca11324fb9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:27.809251 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3aeb1e8f-dc74-483e-9ac7-b3ca11324fb9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:27.829023 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3aeb1e8f-dc74-483e-9ac7-b3ca11324fb9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.220997 Jun 03 15:27:27.840865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 67/111] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:27 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:27.861384 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-90c5abaa-635d-47ed-a766-d15acfbc5d26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:27.862931 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-90c5abaa-635d-47ed-a766-d15acfbc5d26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:27.883599 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90c5abaa-635d-47ed-a766-d15acfbc5d26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:27.885894 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90c5abaa-635d-47ed-a766-d15acfbc5d26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:27.886957 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90c5abaa-635d-47ed-a766-d15acfbc5d26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:27.888422 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90c5abaa-635d-47ed-a766-d15acfbc5d26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:28.081623 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-90c5abaa-635d-47ed-a766-d15acfbc5d26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:28.092710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-90c5abaa-635d-47ed-a766-d15acfbc5d26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.250111 Jun 03 15:27:28.099211 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 68/112] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:27 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:28.120750 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-98435521-d53f-447d-b690-05b3bf09f7c0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:28.121486 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-98435521-d53f-447d-b690-05b3bf09f7c0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:28.136722 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98435521-d53f-447d-b690-05b3bf09f7c0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:28.137218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98435521-d53f-447d-b690-05b3bf09f7c0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:28.138755 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98435521-d53f-447d-b690-05b3bf09f7c0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:28.139219 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98435521-d53f-447d-b690-05b3bf09f7c0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:28.152344 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7fc367a3-7f3e-4210-8abc-7db51df3882a tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "POST /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.910542 Jun 03 15:27:28.157566 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 45/113] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:27:22 2022] POST /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57/os-volume_attachments => generated 194 bytes in 5913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:28.343356 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c196cd41-6af3-464d-b136-b0ac3ef11bae tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:28.344413 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c196cd41-6af3-464d-b136-b0ac3ef11bae tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:28.359990 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c196cd41-6af3-464d-b136-b0ac3ef11bae tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:28.360459 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c196cd41-6af3-464d-b136-b0ac3ef11bae tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:28.363978 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c196cd41-6af3-464d-b136-b0ac3ef11bae tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:28.365049 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c196cd41-6af3-464d-b136-b0ac3ef11bae tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:28.368229 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-98435521-d53f-447d-b690-05b3bf09f7c0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:28.383866 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-98435521-d53f-447d-b690-05b3bf09f7c0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:28.388071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-98435521-d53f-447d-b690-05b3bf09f7c0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:28.390830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-98435521-d53f-447d-b690-05b3bf09f7c0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.295213 Jun 03 15:27:28.391730 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 69/114] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:28 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:28.490761 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=8 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:28.628153 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c196cd41-6af3-464d-b136-b0ac3ef11bae tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:28.636505 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c196cd41-6af3-464d-b136-b0ac3ef11bae tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.299051 Jun 03 15:27:28.637078 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 46/115] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:28 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:28.859026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a83dc8b6-ad6e-4d37-a5de-ea4ba58d9df7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:28.859758 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a83dc8b6-ad6e-4d37-a5de-ea4ba58d9df7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:28.867593 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a83dc8b6-ad6e-4d37-a5de-ea4ba58d9df7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:28.868430 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a83dc8b6-ad6e-4d37-a5de-ea4ba58d9df7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:28.869441 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a83dc8b6-ad6e-4d37-a5de-ea4ba58d9df7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:28.870140 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a83dc8b6-ad6e-4d37-a5de-ea4ba58d9df7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:29.112095 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-fbffee7e-beb1-4c36-a1c3-c943c462b855 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:29.112789 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-fbffee7e-beb1-4c36-a1c3-c943c462b855 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:29.124890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fbffee7e-beb1-4c36-a1c3-c943c462b855 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:29.125345 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fbffee7e-beb1-4c36-a1c3-c943c462b855 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:29.131385 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fbffee7e-beb1-4c36-a1c3-c943c462b855 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:29.131876 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fbffee7e-beb1-4c36-a1c3-c943c462b855 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:29.135525 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:29.684314 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-fbffee7e-beb1-4c36-a1c3-c943c462b855 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:29.695232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-fbffee7e-beb1-4c36-a1c3-c943c462b855 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.589241 Jun 03 15:27:29.698914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 47/116] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:29 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:29.705935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9c8b9ce1-0f97-4c0a-8f71-67bc1f256362 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:29.707250 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9c8b9ce1-0f97-4c0a-8f71-67bc1f256362 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:29.760061 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9c8b9ce1-0f97-4c0a-8f71-67bc1f256362 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:29.760886 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9c8b9ce1-0f97-4c0a-8f71-67bc1f256362 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:29.764127 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9c8b9ce1-0f97-4c0a-8f71-67bc1f256362 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:29.767495 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9c8b9ce1-0f97-4c0a-8f71-67bc1f256362 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:29.881079 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a83dc8b6-ad6e-4d37-a5de-ea4ba58d9df7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:29.895669 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a83dc8b6-ad6e-4d37-a5de-ea4ba58d9df7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 1.040900 Jun 03 15:27:29.896562 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 70/117] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:28 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:29.912341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-dc98567b-885f-4da7-8ab6-41c084f62fb7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:29.913190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-dc98567b-885f-4da7-8ab6-41c084f62fb7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:29.921285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc98567b-885f-4da7-8ab6-41c084f62fb7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:29.921991 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc98567b-885f-4da7-8ab6-41c084f62fb7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:29.922981 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc98567b-885f-4da7-8ab6-41c084f62fb7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:29.923565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc98567b-885f-4da7-8ab6-41c084f62fb7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:30.447913 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9c8b9ce1-0f97-4c0a-8f71-67bc1f256362 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:30.457109 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9c8b9ce1-0f97-4c0a-8f71-67bc1f256362 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:30.458983 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9c8b9ce1-0f97-4c0a-8f71-67bc1f256362 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:30.460815 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9c8b9ce1-0f97-4c0a-8f71-67bc1f256362 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.760613 Jun 03 15:27:30.462230 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 48/118] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:29 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:30.477768 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-653f6ae1-ae27-46b5-9a46-aee635d57d92 req-8b9da415-cb79-44e9-ad73-6b5591602503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce808322-3f17-4d8f-8d33-909ecba99d7a", "name": "network-vif-plugged", "status": "completed", "tag": "4191cebd-3cce-492d-9aee-68a1dfd6dc5f"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:30.488710 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-653f6ae1-ae27-46b5-9a46-aee635d57d92 req-8b9da415-cb79-44e9-ad73-6b5591602503 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:30.489389 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-653f6ae1-ae27-46b5-9a46-aee635d57d92 req-8b9da415-cb79-44e9-ad73-6b5591602503 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:30.503037 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-653f6ae1-ae27-46b5-9a46-aee635d57d92 req-8b9da415-cb79-44e9-ad73-6b5591602503 service nova] Creating event network-vif-plugged:4191cebd-3cce-492d-9aee-68a1dfd6dc5f for instance ce808322-3f17-4d8f-8d33-909ecba99d7a on hv-cinder-83124 Jun 03 15:27:30.508511 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-653f6ae1-ae27-46b5-9a46-aee635d57d92 req-8b9da415-cb79-44e9-ad73-6b5591602503 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044891 Jun 03 15:27:30.509158 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 49/119] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:30.590943 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-dc98567b-885f-4da7-8ab6-41c084f62fb7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:30.600114 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-dc98567b-885f-4da7-8ab6-41c084f62fb7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.692869 Jun 03 15:27:30.601256 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 71/120] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:29 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:30.723412 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-10e28089-de2e-42fd-adf2-06a51ae8a556 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:30.724987 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-10e28089-de2e-42fd-adf2-06a51ae8a556 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:30.734230 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-10e28089-de2e-42fd-adf2-06a51ae8a556 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:30.735010 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-10e28089-de2e-42fd-adf2-06a51ae8a556 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:30.735877 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-10e28089-de2e-42fd-adf2-06a51ae8a556 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:30.736378 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-10e28089-de2e-42fd-adf2-06a51ae8a556 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:30.899052 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-10e28089-de2e-42fd-adf2-06a51ae8a556 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:30.909639 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-10e28089-de2e-42fd-adf2-06a51ae8a556 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.190477 Jun 03 15:27:30.918611 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 50/121] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:30 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:30.918830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e8c104ed-2770-4d29-9d77-d7e6427880f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:30.918830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e8c104ed-2770-4d29-9d77-d7e6427880f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:30.922894 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e8c104ed-2770-4d29-9d77-d7e6427880f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:30.924158 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e8c104ed-2770-4d29-9d77-d7e6427880f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:30.927339 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e8c104ed-2770-4d29-9d77-d7e6427880f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:30.927928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e8c104ed-2770-4d29-9d77-d7e6427880f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:31.141092 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e8c104ed-2770-4d29-9d77-d7e6427880f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:31.149934 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e8c104ed-2770-4d29-9d77-d7e6427880f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.240407 Jun 03 15:27:31.160173 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 72/122] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:30 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:31.488277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-df0b1836-f6b2-4a60-8e7a-019715ce417a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:31.489080 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-df0b1836-f6b2-4a60-8e7a-019715ce417a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:31.502305 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df0b1836-f6b2-4a60-8e7a-019715ce417a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:31.503106 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df0b1836-f6b2-4a60-8e7a-019715ce417a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:31.504218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df0b1836-f6b2-4a60-8e7a-019715ce417a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:31.504826 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df0b1836-f6b2-4a60-8e7a-019715ce417a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:31.652823 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5cb13644-7b97-4d1e-b003-6596cd90e89d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:31.653886 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5cb13644-7b97-4d1e-b003-6596cd90e89d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:31.661312 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5cb13644-7b97-4d1e-b003-6596cd90e89d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:31.662056 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5cb13644-7b97-4d1e-b003-6596cd90e89d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:31.664564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5cb13644-7b97-4d1e-b003-6596cd90e89d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:31.665226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5cb13644-7b97-4d1e-b003-6596cd90e89d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:31.751061 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-df0b1836-f6b2-4a60-8e7a-019715ce417a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:31.767642 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-df0b1836-f6b2-4a60-8e7a-019715ce417a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:31.769752 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-df0b1836-f6b2-4a60-8e7a-019715ce417a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:31.771232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-df0b1836-f6b2-4a60-8e7a-019715ce417a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.294263 Jun 03 15:27:31.772351 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 51/123] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:31 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:31.928956 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-feb09979-0c73-41b3-b0b1-289b887c7950 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:31.929998 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-feb09979-0c73-41b3-b0b1-289b887c7950 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:31.933480 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:31.943151 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-feb09979-0c73-41b3-b0b1-289b887c7950 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:31.943842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-feb09979-0c73-41b3-b0b1-289b887c7950 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:31.945439 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-feb09979-0c73-41b3-b0b1-289b887c7950 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:31.946209 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-feb09979-0c73-41b3-b0b1-289b887c7950 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:32.122432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-feb09979-0c73-41b3-b0b1-289b887c7950 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:32.130943 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-feb09979-0c73-41b3-b0b1-289b887c7950 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.207085 Jun 03 15:27:32.131537 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 52/124] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:31 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:32.169943 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9af9dab2-4150-43ef-a1cd-f36c59b52547 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:32.171573 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9af9dab2-4150-43ef-a1cd-f36c59b52547 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:32.180905 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9af9dab2-4150-43ef-a1cd-f36c59b52547 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:32.181727 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9af9dab2-4150-43ef-a1cd-f36c59b52547 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:32.184661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9af9dab2-4150-43ef-a1cd-f36c59b52547 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:32.185510 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9af9dab2-4150-43ef-a1cd-f36c59b52547 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:32.211089 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5cb13644-7b97-4d1e-b003-6596cd90e89d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:32.223596 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5cb13644-7b97-4d1e-b003-6596cd90e89d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.605831 Jun 03 15:27:32.228057 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 73/125] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:31 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:32.370015 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9af9dab2-4150-43ef-a1cd-f36c59b52547 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:32.380284 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9af9dab2-4150-43ef-a1cd-f36c59b52547 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.216155 Jun 03 15:27:32.380900 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 53/126] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:32 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:32.528894 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-442c4bde-8aaf-4a8b-a4fd-858769b86b9a req-8fced685-2891-48b2-a520-52ada788ec4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9be206f-1554-46fe-9fa7-581d2d394865", "name": "network-vif-plugged", "status": "completed", "tag": "67597138-621c-43e8-af88-f2fa1bf44d03"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:32.540941 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-442c4bde-8aaf-4a8b-a4fd-858769b86b9a req-8fced685-2891-48b2-a520-52ada788ec4d service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:32.541858 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-442c4bde-8aaf-4a8b-a4fd-858769b86b9a req-8fced685-2891-48b2-a520-52ada788ec4d service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:32.559013 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-442c4bde-8aaf-4a8b-a4fd-858769b86b9a req-8fced685-2891-48b2-a520-52ada788ec4d service nova] Creating event network-vif-plugged:67597138-621c-43e8-af88-f2fa1bf44d03 for instance f9be206f-1554-46fe-9fa7-581d2d394865 on hv-cinder-83124 Jun 03 15:27:32.564639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-442c4bde-8aaf-4a8b-a4fd-858769b86b9a req-8fced685-2891-48b2-a520-52ada788ec4d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039479 Jun 03 15:27:32.568026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 74/127] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:32.789730 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0186bdaa-302b-4406-b25b-b76a743221a2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:32.790848 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0186bdaa-302b-4406-b25b-b76a743221a2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:32.807959 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0186bdaa-302b-4406-b25b-b76a743221a2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:32.809669 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0186bdaa-302b-4406-b25b-b76a743221a2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:32.810683 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0186bdaa-302b-4406-b25b-b76a743221a2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:32.820654 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0186bdaa-302b-4406-b25b-b76a743221a2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:33.150045 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ca1c0dc5-b038-4b89-997a-8528c74e11db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:33.150845 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ca1c0dc5-b038-4b89-997a-8528c74e11db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:33.158912 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ca1c0dc5-b038-4b89-997a-8528c74e11db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:33.159538 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ca1c0dc5-b038-4b89-997a-8528c74e11db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:33.160519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ca1c0dc5-b038-4b89-997a-8528c74e11db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:33.161203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ca1c0dc5-b038-4b89-997a-8528c74e11db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:33.165082 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=100 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:33.242514 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0186bdaa-302b-4406-b25b-b76a743221a2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:33.253939 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0186bdaa-302b-4406-b25b-b76a743221a2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:33.256208 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0186bdaa-302b-4406-b25b-b76a743221a2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:33.257437 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0186bdaa-302b-4406-b25b-b76a743221a2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.472136 Jun 03 15:27:33.258000 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 54/128] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:32 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:33.274323 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e5b18034-b7bb-4cc0-b2ae-052fceb856d2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:33.275759 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e5b18034-b7bb-4cc0-b2ae-052fceb856d2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:33.284500 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5b18034-b7bb-4cc0-b2ae-052fceb856d2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:33.285229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5b18034-b7bb-4cc0-b2ae-052fceb856d2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:33.286172 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5b18034-b7bb-4cc0-b2ae-052fceb856d2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:33.286696 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5b18034-b7bb-4cc0-b2ae-052fceb856d2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:33.450637 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e5b18034-b7bb-4cc0-b2ae-052fceb856d2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:33.497472 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e5b18034-b7bb-4cc0-b2ae-052fceb856d2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.237165 Jun 03 15:27:33.501199 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 55/129] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:33 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:33.517571 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9234a72b-f0a1-4606-93dd-b877010f01aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:33.518853 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9234a72b-f0a1-4606-93dd-b877010f01aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:33.532470 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9234a72b-f0a1-4606-93dd-b877010f01aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:33.533038 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9234a72b-f0a1-4606-93dd-b877010f01aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:33.534329 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9234a72b-f0a1-4606-93dd-b877010f01aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:33.534991 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9234a72b-f0a1-4606-93dd-b877010f01aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:33.616644 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ca1c0dc5-b038-4b89-997a-8528c74e11db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:33.630787 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ca1c0dc5-b038-4b89-997a-8528c74e11db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.484276 Jun 03 15:27:33.642598 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 75/130] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:33 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:34.288430 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-72806476-ee3c-4230-b3f9-4529b7392290 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:34.289191 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-72806476-ee3c-4230-b3f9-4529b7392290 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:34.292958 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9234a72b-f0a1-4606-93dd-b877010f01aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:34.312659 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9234a72b-f0a1-4606-93dd-b877010f01aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1362 microversion: 2.1 time: 0.810288 Jun 03 15:27:34.322006 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 56/131] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:33 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1362 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:34.345277 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-72806476-ee3c-4230-b3f9-4529b7392290 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:34.347025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-72806476-ee3c-4230-b3f9-4529b7392290 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:34.352987 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-72806476-ee3c-4230-b3f9-4529b7392290 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:34.354498 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-72806476-ee3c-4230-b3f9-4529b7392290 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:34.517810 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-91e88260-fe1e-48ec-b8d7-985c591af463 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:34.518505 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-91e88260-fe1e-48ec-b8d7-985c591af463 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:34.532396 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91e88260-fe1e-48ec-b8d7-985c591af463 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:34.532973 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91e88260-fe1e-48ec-b8d7-985c591af463 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:34.537333 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91e88260-fe1e-48ec-b8d7-985c591af463 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:34.538511 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91e88260-fe1e-48ec-b8d7-985c591af463 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:34.746667 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-72806476-ee3c-4230-b3f9-4529b7392290 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:34.756418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-72806476-ee3c-4230-b3f9-4529b7392290 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:34.767861 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-72806476-ee3c-4230-b3f9-4529b7392290 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:34.769024 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-72806476-ee3c-4230-b3f9-4529b7392290 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.486552 Jun 03 15:27:34.771759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 76/132] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:34 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:34.777753 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-884b2607-9572-47c2-8274-ec43b8e959b1 req-a6c9efeb-35d1-42fd-a23b-ba17b3fca325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123dc0c-78c6-44ce-b847-927843a3751c", "name": "network-vif-plugged", "status": "completed", "tag": "d065a51d-4c7e-482f-87f7-74c4d679a6c1"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:34.799244 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-884b2607-9572-47c2-8274-ec43b8e959b1 req-a6c9efeb-35d1-42fd-a23b-ba17b3fca325 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:34.799678 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-884b2607-9572-47c2-8274-ec43b8e959b1 req-a6c9efeb-35d1-42fd-a23b-ba17b3fca325 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:34.818585 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-884b2607-9572-47c2-8274-ec43b8e959b1 req-a6c9efeb-35d1-42fd-a23b-ba17b3fca325 service nova] Creating event network-vif-plugged:d065a51d-4c7e-482f-87f7-74c4d679a6c1 for instance e123dc0c-78c6-44ce-b847-927843a3751c on hv-cinder-83124 Jun 03 15:27:34.826499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-884b2607-9572-47c2-8274-ec43b8e959b1 req-a6c9efeb-35d1-42fd-a23b-ba17b3fca325 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052387 Jun 03 15:27:34.828164 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 77/133] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:34.836259 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f7ee376e-8298-46bd-8727-d7a4d45c94f6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:34.839131 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f7ee376e-8298-46bd-8727-d7a4d45c94f6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:34.843158 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-91e88260-fe1e-48ec-b8d7-985c591af463 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:34.848874 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f7ee376e-8298-46bd-8727-d7a4d45c94f6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:34.849700 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f7ee376e-8298-46bd-8727-d7a4d45c94f6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:34.851076 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f7ee376e-8298-46bd-8727-d7a4d45c94f6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:34.851673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f7ee376e-8298-46bd-8727-d7a4d45c94f6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:34.853377 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-91e88260-fe1e-48ec-b8d7-985c591af463 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1368 microversion: 2.1 time: 0.339920 Jun 03 15:27:34.854075 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 57/134] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:34 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1368 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:35.143632 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f7ee376e-8298-46bd-8727-d7a4d45c94f6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:35.155303 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f7ee376e-8298-46bd-8727-d7a4d45c94f6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.323640 Jun 03 15:27:35.156006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 78/135] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:34 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:35.350934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-15432f5a-b694-4492-9708-3c3e7ef03ff0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:35.353197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-15432f5a-b694-4492-9708-3c3e7ef03ff0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:35.396355 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-15432f5a-b694-4492-9708-3c3e7ef03ff0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:35.399591 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-15432f5a-b694-4492-9708-3c3e7ef03ff0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:35.408935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-15432f5a-b694-4492-9708-3c3e7ef03ff0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:35.413400 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-15432f5a-b694-4492-9708-3c3e7ef03ff0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:35.645538 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-15432f5a-b694-4492-9708-3c3e7ef03ff0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:35.672091 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-15432f5a-b694-4492-9708-3c3e7ef03ff0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1548 microversion: 2.1 time: 0.335984 Jun 03 15:27:35.675257 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 58/136] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:35 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1548 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:35.700220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ab1c9c0e-a9cd-4489-b418-230b9aa3cafb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:35.700773 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ab1c9c0e-a9cd-4489-b418-230b9aa3cafb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:35.713295 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ab1c9c0e-a9cd-4489-b418-230b9aa3cafb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:35.713756 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ab1c9c0e-a9cd-4489-b418-230b9aa3cafb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:35.714578 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ab1c9c0e-a9cd-4489-b418-230b9aa3cafb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:35.715015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ab1c9c0e-a9cd-4489-b418-230b9aa3cafb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:35.790963 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2554ffd3-5991-48a8-befe-03d44f059ea3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:35.791976 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2554ffd3-5991-48a8-befe-03d44f059ea3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:35.800764 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2554ffd3-5991-48a8-befe-03d44f059ea3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:35.801958 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2554ffd3-5991-48a8-befe-03d44f059ea3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:35.802964 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2554ffd3-5991-48a8-befe-03d44f059ea3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:35.804760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2554ffd3-5991-48a8-befe-03d44f059ea3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:35.915704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ab1c9c0e-a9cd-4489-b418-230b9aa3cafb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.226558 Jun 03 15:27:35.916415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 79/137] 10.222.0.93 () {58 vars in 1274 bytes} [Fri Jun 3 15:27:35 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:35.922999 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-265391a9-79a6-44e1-b2a8-9b494d73a008 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:35.924020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-265391a9-79a6-44e1-b2a8-9b494d73a008 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:35.947594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-265391a9-79a6-44e1-b2a8-9b494d73a008 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:35.949946 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-265391a9-79a6-44e1-b2a8-9b494d73a008 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:35.957974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-265391a9-79a6-44e1-b2a8-9b494d73a008 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:35.957974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-265391a9-79a6-44e1-b2a8-9b494d73a008 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:36.195633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2554ffd3-5991-48a8-befe-03d44f059ea3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:36.210464 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2554ffd3-5991-48a8-befe-03d44f059ea3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:36.215378 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2554ffd3-5991-48a8-befe-03d44f059ea3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:36.218474 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2554ffd3-5991-48a8-befe-03d44f059ea3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.431211 Jun 03 15:27:36.219809 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 59/138] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:35 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:27:36.233501 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a8eb43f8-ade4-4040-8eb0-cb596ee11c38 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:36.234306 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a8eb43f8-ade4-4040-8eb0-cb596ee11c38 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:36.248890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8eb43f8-ade4-4040-8eb0-cb596ee11c38 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:36.249627 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8eb43f8-ade4-4040-8eb0-cb596ee11c38 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:36.250685 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8eb43f8-ade4-4040-8eb0-cb596ee11c38 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:36.251644 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8eb43f8-ade4-4040-8eb0-cb596ee11c38 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:36.539280 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a8eb43f8-ade4-4040-8eb0-cb596ee11c38 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:36.554445 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a8eb43f8-ade4-4040-8eb0-cb596ee11c38 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.330095 Jun 03 15:27:36.555962 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 60/139] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:36 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:36.874262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-02f99662-21ad-459a-94ee-417025ba8c22 req-2e7c4c3e-75ca-4c44-b9b2-4f17a5c1c25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758b095c-6da9-4d53-abba-6a13a7c50904", "name": "network-vif-plugged", "status": "completed", "tag": "a6777d99-9001-40c7-8dc0-bac5ca7c5efe"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:36.890385 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-02f99662-21ad-459a-94ee-417025ba8c22 req-2e7c4c3e-75ca-4c44-b9b2-4f17a5c1c25e service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:36.892508 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-02f99662-21ad-459a-94ee-417025ba8c22 req-2e7c4c3e-75ca-4c44-b9b2-4f17a5c1c25e service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:36.968273 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-02f99662-21ad-459a-94ee-417025ba8c22 req-2e7c4c3e-75ca-4c44-b9b2-4f17a5c1c25e service nova] Creating event network-vif-plugged:a6777d99-9001-40c7-8dc0-bac5ca7c5efe for instance 758b095c-6da9-4d53-abba-6a13a7c50904 on hv-cinder-83124 Jun 03 15:27:36.987100 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-02f99662-21ad-459a-94ee-417025ba8c22 req-2e7c4c3e-75ca-4c44-b9b2-4f17a5c1c25e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116224 Jun 03 15:27:36.993057 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 61/140] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:37.074612 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-265391a9-79a6-44e1-b2a8-9b494d73a008 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:37.100142 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-265391a9-79a6-44e1-b2a8-9b494d73a008 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1558 microversion: 2.1 time: 1.182404 Jun 03 15:27:37.105171 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 80/141] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:35 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1558 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:37.124892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2279beb1-bb6d-4b64-8701-e76d17241f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:37.125632 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2279beb1-bb6d-4b64-8701-e76d17241f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:37.141226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2279beb1-bb6d-4b64-8701-e76d17241f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:37.142204 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2279beb1-bb6d-4b64-8701-e76d17241f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:37.143320 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2279beb1-bb6d-4b64-8701-e76d17241f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:37.146006 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2279beb1-bb6d-4b64-8701-e76d17241f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:37.239260 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-af1804f9-cb2a-4ad1-b7aa-73bfd729a9f6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:37.240635 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-af1804f9-cb2a-4ad1-b7aa-73bfd729a9f6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:37.251644 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-af1804f9-cb2a-4ad1-b7aa-73bfd729a9f6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:37.252357 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-af1804f9-cb2a-4ad1-b7aa-73bfd729a9f6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:37.260140 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-af1804f9-cb2a-4ad1-b7aa-73bfd729a9f6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:37.260788 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-af1804f9-cb2a-4ad1-b7aa-73bfd729a9f6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:37.360720 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2279beb1-bb6d-4b64-8701-e76d17241f6a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.242809 Jun 03 15:27:37.361781 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 62/142] 10.222.0.93 () {58 vars in 1274 bytes} [Fri Jun 3 15:27:37 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/os-interface => generated 284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:37.576717 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ef15e5c1-a814-460a-9a6f-a8c70d748bc2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:37.577504 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ef15e5c1-a814-460a-9a6f-a8c70d748bc2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:37.595884 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ef15e5c1-a814-460a-9a6f-a8c70d748bc2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:37.596401 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ef15e5c1-a814-460a-9a6f-a8c70d748bc2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:37.602301 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ef15e5c1-a814-460a-9a6f-a8c70d748bc2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:37.602893 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ef15e5c1-a814-460a-9a6f-a8c70d748bc2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:38.009094 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-af1804f9-cb2a-4ad1-b7aa-73bfd729a9f6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:38.032991 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-af1804f9-cb2a-4ad1-b7aa-73bfd729a9f6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:38.035201 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ef15e5c1-a814-460a-9a6f-a8c70d748bc2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:38.038496 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-af1804f9-cb2a-4ad1-b7aa-73bfd729a9f6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:38.042691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-af1804f9-cb2a-4ad1-b7aa-73bfd729a9f6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.806966 Jun 03 15:27:38.044664 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 81/143] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:37 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:27:38.049261 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ef15e5c1-a814-460a-9a6f-a8c70d748bc2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.480536 Jun 03 15:27:38.052295 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 63/144] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:37 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:39.062415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-61b356c9-9021-423c-a067-64a79cf7c103 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:39.063868 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-61b356c9-9021-423c-a067-64a79cf7c103 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:39.069594 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-95052c01-2ced-49f4-9cc1-095e1b2abb52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:39.070212 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-95052c01-2ced-49f4-9cc1-095e1b2abb52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:39.072067 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-61b356c9-9021-423c-a067-64a79cf7c103 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:39.076495 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-61b356c9-9021-423c-a067-64a79cf7c103 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:39.079882 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-61b356c9-9021-423c-a067-64a79cf7c103 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:39.080618 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-61b356c9-9021-423c-a067-64a79cf7c103 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:39.086905 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-95052c01-2ced-49f4-9cc1-095e1b2abb52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:39.087591 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-95052c01-2ced-49f4-9cc1-095e1b2abb52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:39.088386 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-95052c01-2ced-49f4-9cc1-095e1b2abb52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:39.090382 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-95052c01-2ced-49f4-9cc1-095e1b2abb52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:39.497752 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-95052c01-2ced-49f4-9cc1-095e1b2abb52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:39.513960 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-95052c01-2ced-49f4-9cc1-095e1b2abb52 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.446186 Jun 03 15:27:39.514888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 64/145] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:39 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:39.530882 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f5ac2491-06b3-4157-917f-21fc3c3c9c62 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:39.531866 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f5ac2491-06b3-4157-917f-21fc3c3c9c62 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:39.543163 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f5ac2491-06b3-4157-917f-21fc3c3c9c62 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:39.543613 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f5ac2491-06b3-4157-917f-21fc3c3c9c62 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:39.544393 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f5ac2491-06b3-4157-917f-21fc3c3c9c62 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:39.546211 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f5ac2491-06b3-4157-917f-21fc3c3c9c62 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:39.592451 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=100 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:39.624792 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f5ac2491-06b3-4157-917f-21fc3c3c9c62 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:27:39.633563 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-61b356c9-9021-423c-a067-64a79cf7c103 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:39.643928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-61b356c9-9021-423c-a067-64a79cf7c103 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:39.665321 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-61b356c9-9021-423c-a067-64a79cf7c103 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:39.666524 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-61b356c9-9021-423c-a067-64a79cf7c103 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1406 microversion: 2.20 time: 0.607990 Jun 03 15:27:39.669937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 82/146] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:39 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1406 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:39.868467 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f5ac2491-06b3-4157-917f-21fc3c3c9c62 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 204 len: 0 microversion: 2.1 time: 0.351129 Jun 03 15:27:39.869877 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 65/147] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:27:39 2022] DELETE /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:27:39.877942 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-78ae077d-9590-4f8e-a6cd-6d9c62351fec tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:39.878611 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-78ae077d-9590-4f8e-a6cd-6d9c62351fec tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:39.912696 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-78ae077d-9590-4f8e-a6cd-6d9c62351fec tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:39.914492 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-78ae077d-9590-4f8e-a6cd-6d9c62351fec tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:39.921841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-78ae077d-9590-4f8e-a6cd-6d9c62351fec tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:39.922294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-78ae077d-9590-4f8e-a6cd-6d9c62351fec tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:40.041879 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-309c350c-8bea-4b0d-b373-16886fb960e7 req-5a8c168e-4f56-4412-bebe-e8685d2418d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce808322-3f17-4d8f-8d33-909ecba99d7a", "tag": "4191cebd-3cce-492d-9aee-68a1dfd6dc5f"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:40.079314 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-309c350c-8bea-4b0d-b373-16886fb960e7 req-5a8c168e-4f56-4412-bebe-e8685d2418d0 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:40.083072 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-309c350c-8bea-4b0d-b373-16886fb960e7 req-5a8c168e-4f56-4412-bebe-e8685d2418d0 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:40.130862 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-309c350c-8bea-4b0d-b373-16886fb960e7 req-5a8c168e-4f56-4412-bebe-e8685d2418d0 service nova] Creating event network-changed:4191cebd-3cce-492d-9aee-68a1dfd6dc5f for instance ce808322-3f17-4d8f-8d33-909ecba99d7a on hv-cinder-83124 Jun 03 15:27:40.155850 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-309c350c-8bea-4b0d-b373-16886fb960e7 req-5a8c168e-4f56-4412-bebe-e8685d2418d0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119619 Jun 03 15:27:40.158842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 66/148] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:40.538521 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4dd51684-1fa4-46f7-8520-d3e68d83bc26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:40.540376 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4dd51684-1fa4-46f7-8520-d3e68d83bc26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:40.555235 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4dd51684-1fa4-46f7-8520-d3e68d83bc26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:40.556572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4dd51684-1fa4-46f7-8520-d3e68d83bc26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:40.557897 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4dd51684-1fa4-46f7-8520-d3e68d83bc26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:40.558498 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4dd51684-1fa4-46f7-8520-d3e68d83bc26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:40.575367 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-78ae077d-9590-4f8e-a6cd-6d9c62351fec tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:40.596722 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-78ae077d-9590-4f8e-a6cd-6d9c62351fec tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1553 microversion: 2.1 time: 0.719975 Jun 03 15:27:40.598026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 83/149] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:39 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1553 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:40.619204 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-1ce76ddd-4556-42ae-b2d2-5c9938bbd50d req-63a8ab74-f806-4843-ac9b-a52920fa27f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9be206f-1554-46fe-9fa7-581d2d394865", "tag": "67597138-621c-43e8-af88-f2fa1bf44d03"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:40.668366 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-1ce76ddd-4556-42ae-b2d2-5c9938bbd50d req-63a8ab74-f806-4843-ac9b-a52920fa27f5 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:40.675056 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-1ce76ddd-4556-42ae-b2d2-5c9938bbd50d req-63a8ab74-f806-4843-ac9b-a52920fa27f5 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:40.713278 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-1ce76ddd-4556-42ae-b2d2-5c9938bbd50d req-63a8ab74-f806-4843-ac9b-a52920fa27f5 service nova] Creating event network-changed:67597138-621c-43e8-af88-f2fa1bf44d03 for instance f9be206f-1554-46fe-9fa7-581d2d394865 on hv-cinder-83124 Jun 03 15:27:40.718820 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-1ce76ddd-4556-42ae-b2d2-5c9938bbd50d req-63a8ab74-f806-4843-ac9b-a52920fa27f5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117534 Jun 03 15:27:40.721607 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 84/150] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:40.728472 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f07184e2-a175-42ec-922b-d778dcdedc54 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:40.729405 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f07184e2-a175-42ec-922b-d778dcdedc54 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:40.743680 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f07184e2-a175-42ec-922b-d778dcdedc54 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:40.744674 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f07184e2-a175-42ec-922b-d778dcdedc54 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:40.745740 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f07184e2-a175-42ec-922b-d778dcdedc54 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:40.746394 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f07184e2-a175-42ec-922b-d778dcdedc54 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:40.929082 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4dd51684-1fa4-46f7-8520-d3e68d83bc26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:40.944103 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4dd51684-1fa4-46f7-8520-d3e68d83bc26 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 0.409565 Jun 03 15:27:40.955605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 67/151] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:40 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:41.030861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-162a90f1-8eb0-4091-91d7-29f6eae79cf7 req-60c0cb20-508f-413c-a87a-d4fcf2b552fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3", "name": "network-vif-plugged", "status": "completed", "tag": "d4a71b7c-b829-4818-a730-8eda807ebe70"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:41.048162 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-162a90f1-8eb0-4091-91d7-29f6eae79cf7 req-60c0cb20-508f-413c-a87a-d4fcf2b552fd service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:41.051324 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-162a90f1-8eb0-4091-91d7-29f6eae79cf7 req-60c0cb20-508f-413c-a87a-d4fcf2b552fd service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:41.083296 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-162a90f1-8eb0-4091-91d7-29f6eae79cf7 req-60c0cb20-508f-413c-a87a-d4fcf2b552fd service nova] Creating event network-vif-plugged:d4a71b7c-b829-4818-a730-8eda807ebe70 for instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 on hv-cinder-83124 Jun 03 15:27:41.098809 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-162a90f1-8eb0-4091-91d7-29f6eae79cf7 req-60c0cb20-508f-413c-a87a-d4fcf2b552fd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070400 Jun 03 15:27:41.099469 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 68/152] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:27:41.142798 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f07184e2-a175-42ec-922b-d778dcdedc54 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:41.153391 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f07184e2-a175-42ec-922b-d778dcdedc54 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:41.159954 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f07184e2-a175-42ec-922b-d778dcdedc54 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:41.161360 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f07184e2-a175-42ec-922b-d778dcdedc54 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1598 microversion: 2.20 time: 0.438320 Jun 03 15:27:41.164894 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 85/153] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:27:40 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1598 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:27:41.187713 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c2635fd6-92e5-46db-9422-5f843353f6c4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:41.188376 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c2635fd6-92e5-46db-9422-5f843353f6c4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:41.206068 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2635fd6-92e5-46db-9422-5f843353f6c4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:41.207050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2635fd6-92e5-46db-9422-5f843353f6c4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:41.208093 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2635fd6-92e5-46db-9422-5f843353f6c4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:41.208694 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2635fd6-92e5-46db-9422-5f843353f6c4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:41.411290 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c2635fd6-92e5-46db-9422-5f843353f6c4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.231534 Jun 03 15:27:41.421120 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 69/154] 10.222.0.93 () {60 vars in 1315 bytes} [Fri Jun 3 15:27:41 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-interface => generated 284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:27:41.615548 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2d398399-e61d-4eae-8e73-715136861c38 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:41.616324 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2d398399-e61d-4eae-8e73-715136861c38 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:41.633106 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2d398399-e61d-4eae-8e73-715136861c38 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:41.633670 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2d398399-e61d-4eae-8e73-715136861c38 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:41.634827 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2d398399-e61d-4eae-8e73-715136861c38 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:41.635685 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2d398399-e61d-4eae-8e73-715136861c38 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:41.962341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9460a9d0-29e7-46af-8cf2-b89bb3f8a8d9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:41.963304 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9460a9d0-29e7-46af-8cf2-b89bb3f8a8d9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:41.976707 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9460a9d0-29e7-46af-8cf2-b89bb3f8a8d9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:41.984237 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9460a9d0-29e7-46af-8cf2-b89bb3f8a8d9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:41.989449 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9460a9d0-29e7-46af-8cf2-b89bb3f8a8d9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:41.990637 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9460a9d0-29e7-46af-8cf2-b89bb3f8a8d9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:42.277240 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2d398399-e61d-4eae-8e73-715136861c38 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:42.308299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2d398399-e61d-4eae-8e73-715136861c38 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1553 microversion: 2.1 time: 0.696539 Jun 03 15:27:42.321950 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 86/155] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:41 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1553 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:43.258565 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9460a9d0-29e7-46af-8cf2-b89bb3f8a8d9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:43.269800 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9460a9d0-29e7-46af-8cf2-b89bb3f8a8d9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1322 microversion: 2.1 time: 1.312237 Jun 03 15:27:43.273249 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 70/156] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:41 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1322 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:43.328607 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6db3f59c-c67d-411b-ac25-f2e5516c3873 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:43.337148 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6db3f59c-c67d-411b-ac25-f2e5516c3873 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:43.358959 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6db3f59c-c67d-411b-ac25-f2e5516c3873 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:43.365172 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6db3f59c-c67d-411b-ac25-f2e5516c3873 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:43.366040 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6db3f59c-c67d-411b-ac25-f2e5516c3873 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:43.366484 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6db3f59c-c67d-411b-ac25-f2e5516c3873 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:43.476017 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-f85dab91-d384-4c8d-b41e-bb70a86619c4 req-110b5d2f-580e-4598-920d-d61338e72a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e123dc0c-78c6-44ce-b847-927843a3751c", "tag": "d065a51d-4c7e-482f-87f7-74c4d679a6c1"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:43.494354 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-f85dab91-d384-4c8d-b41e-bb70a86619c4 req-110b5d2f-580e-4598-920d-d61338e72a23 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:43.498756 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-f85dab91-d384-4c8d-b41e-bb70a86619c4 req-110b5d2f-580e-4598-920d-d61338e72a23 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:43.523820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-f85dab91-d384-4c8d-b41e-bb70a86619c4 req-110b5d2f-580e-4598-920d-d61338e72a23 service nova] Creating event network-changed:d065a51d-4c7e-482f-87f7-74c4d679a6c1 for instance e123dc0c-78c6-44ce-b847-927843a3751c on hv-cinder-83124 Jun 03 15:27:43.546788 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-f85dab91-d384-4c8d-b41e-bb70a86619c4 req-110b5d2f-580e-4598-920d-d61338e72a23 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074925 Jun 03 15:27:43.548968 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 71/157] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:27:44.287994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cca8de6f-75cf-4327-9787-49ce25e346b7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:44.288837 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-cca8de6f-75cf-4327-9787-49ce25e346b7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:44.310629 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cca8de6f-75cf-4327-9787-49ce25e346b7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:44.317482 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cca8de6f-75cf-4327-9787-49ce25e346b7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:44.318632 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cca8de6f-75cf-4327-9787-49ce25e346b7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:44.319969 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cca8de6f-75cf-4327-9787-49ce25e346b7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:44.507483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6db3f59c-c67d-411b-ac25-f2e5516c3873 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:44.519154 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6db3f59c-c67d-411b-ac25-f2e5516c3873 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1553 microversion: 2.1 time: 1.194339 Jun 03 15:27:44.523420 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 87/158] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:43 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1553 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:45.198464 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-cca8de6f-75cf-4327-9787-49ce25e346b7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:45.215016 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-cca8de6f-75cf-4327-9787-49ce25e346b7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1516 microversion: 2.1 time: 0.931833 Jun 03 15:27:45.227042 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 72/159] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:44 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1516 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:27:45.234286 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7b4a3f14-a753-4f57-9dcf-07b154a02175 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:45.236514 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7b4a3f14-a753-4f57-9dcf-07b154a02175 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:45.244523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7b4a3f14-a753-4f57-9dcf-07b154a02175 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:45.245263 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7b4a3f14-a753-4f57-9dcf-07b154a02175 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:45.246559 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7b4a3f14-a753-4f57-9dcf-07b154a02175 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:45.246996 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7b4a3f14-a753-4f57-9dcf-07b154a02175 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:45.280956 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-7b4a3f14-a753-4f57-9dcf-07b154a02175 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lazy-loading 'flavor' on Instance uuid 758b095c-6da9-4d53-abba-6a13a7c50904 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:27:45.515150 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7b4a3f14-a753-4f57-9dcf-07b154a02175 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904/action" status: 200 len: 32 microversion: 2.1 time: 0.284336 Jun 03 15:27:45.517117 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 88/160] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:27:45 2022] POST /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904/action => generated 32 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 15:27:45.526586 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a895a939-7712-433e-b400-581851f5277e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:45.527768 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a895a939-7712-433e-b400-581851f5277e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:45.543807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a895a939-7712-433e-b400-581851f5277e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:45.544593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a895a939-7712-433e-b400-581851f5277e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:45.545999 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a895a939-7712-433e-b400-581851f5277e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:45.547665 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a895a939-7712-433e-b400-581851f5277e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:45.548255 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-fec4b7d0-776b-4746-8da7-8a4998af7766 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:45.551089 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-fec4b7d0-776b-4746-8da7-8a4998af7766 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:45.567821 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fec4b7d0-776b-4746-8da7-8a4998af7766 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:45.572555 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fec4b7d0-776b-4746-8da7-8a4998af7766 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:45.573843 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fec4b7d0-776b-4746-8da7-8a4998af7766 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:45.574498 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fec4b7d0-776b-4746-8da7-8a4998af7766 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:45.710285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-fec4b7d0-776b-4746-8da7-8a4998af7766 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:45.756993 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-fec4b7d0-776b-4746-8da7-8a4998af7766 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1511 microversion: 2.1 time: 0.212028 Jun 03 15:27:45.758105 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 89/161] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:45 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:45.780216 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-35758b66-103b-4f50-bd1b-650c81bc2cfd req-cd40b746-da3d-459c-a682-39e4ba70eb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7caaae-2b81-44c6-9fbb-a01d2af87b57", "name": "network-vif-deleted", "tag": "e2167245-4216-4805-83ad-80b71ead6e3d"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:45.803860 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-35758b66-103b-4f50-bd1b-650c81bc2cfd req-cd40b746-da3d-459c-a682-39e4ba70eb2f service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:45.804328 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-35758b66-103b-4f50-bd1b-650c81bc2cfd req-cd40b746-da3d-459c-a682-39e4ba70eb2f service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:45.829073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-35758b66-103b-4f50-bd1b-650c81bc2cfd req-cd40b746-da3d-459c-a682-39e4ba70eb2f service nova] Creating event network-vif-deleted:e2167245-4216-4805-83ad-80b71ead6e3d for instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 on hv-cinder-83124 Jun 03 15:27:45.855674 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-35758b66-103b-4f50-bd1b-650c81bc2cfd req-cd40b746-da3d-459c-a682-39e4ba70eb2f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087624 Jun 03 15:27:45.859989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 90/162] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:46.032343 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a895a939-7712-433e-b400-581851f5277e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:46.043254 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a895a939-7712-433e-b400-581851f5277e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.521174 Jun 03 15:27:46.044174 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 73/163] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:45 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:46.794629 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:46.797087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:46.827838 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:46.833548 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:46.850175 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:46.851027 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:46.941813 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:46.944113 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:46.946832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lazy-loading 'fault' on Instance uuid 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:27:47.063357 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ca21f897-1388-4cda-a259-ce64918901c6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:47.063828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:47.063958 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ca21f897-1388-4cda-a259-ce64918901c6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:47.065816 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:47.078960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1e658042-25ae-435e-a65f-a40cd4c33580 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1351 microversion: 2.1 time: 0.303050 Jun 03 15:27:47.081335 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 91/164] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:46 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1351 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:47.095175 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ca21f897-1388-4cda-a259-ce64918901c6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:47.095638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ca21f897-1388-4cda-a259-ce64918901c6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:47.096382 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ca21f897-1388-4cda-a259-ce64918901c6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:47.096812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ca21f897-1388-4cda-a259-ce64918901c6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:47.381983 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ca21f897-1388-4cda-a259-ce64918901c6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:47.391857 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ca21f897-1388-4cda-a259-ce64918901c6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.333241 Jun 03 15:27:47.403968 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 74/165] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:47 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:48.097137 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:48.097959 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:48.105141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:48.110861 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:48.112035 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:48.118557 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:48.194832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:48.198242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:48.198767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lazy-loading 'fault' on Instance uuid 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:27:48.313406 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd62219456547db82c2f5416d4f44f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683acaeef18d43b4ac3daeb60e3a8aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:48.322118 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2c53a5a1-cbc8-45d9-a6f6-ac6c5745bd2f tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 200 len: 1305 microversion: 2.1 time: 0.228628 Jun 03 15:27:48.322726 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 92/166] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:48 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 1305 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:48.414317 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0e9e613f-48ea-4dda-88b6-6cf1369c0207 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:48.414947 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0e9e613f-48ea-4dda-88b6-6cf1369c0207 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:48.423234 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0e9e613f-48ea-4dda-88b6-6cf1369c0207 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:48.423997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0e9e613f-48ea-4dda-88b6-6cf1369c0207 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:48.424949 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0e9e613f-48ea-4dda-88b6-6cf1369c0207 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:48.425558 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0e9e613f-48ea-4dda-88b6-6cf1369c0207 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:48.622761 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0e9e613f-48ea-4dda-88b6-6cf1369c0207 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:48.632116 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0e9e613f-48ea-4dda-88b6-6cf1369c0207 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.224008 Jun 03 15:27:48.632697 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 75/167] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:48 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:49.341463 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-89f399ec-9ce4-4c83-8c92-954840d14bb1 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:49.342157 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-89f399ec-9ce4-4c83-8c92-954840d14bb1 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:49.373827 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89f399ec-9ce4-4c83-8c92-954840d14bb1 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:49.375217 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89f399ec-9ce4-4c83-8c92-954840d14bb1 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:49.376630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89f399ec-9ce4-4c83-8c92-954840d14bb1 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:49.378354 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89f399ec-9ce4-4c83-8c92-954840d14bb1 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:49.404484 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-89f399ec-9ce4-4c83-8c92-954840d14bb1 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] HTTP exception thrown: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-89f399ec-9ce4-4c83-8c92-954840d14bb1 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Request method failure captured: Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 HTTP/1.1 Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigrMe2AzF3iMyQ04EQR_t_BAkXli_s0-UMa5Wkm6W7cxtkBoUqS4S7gvGw6WFtCF2PuFVw8jkswPF0_PdS7hnEU0HM3bxnokdjEcL9w5ZAbSUoSBknTGxD14jVXFK-F7VDApDwkPB-8sDa9CZSRRtRpPrwbHfetwJ6176sbcA7AwdY Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 683acaeef18d43b4ac3daeb60e3a8aea Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:27:49.410349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/683acaeef18d43b4ac3daeb60e3a8aea"}]}] Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 683acaeef18d43b4ac3daeb60e3a8aea Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-DeleteServersTestJSON-1895403467-project Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: bdd62219456547db82c2f5416d4f44f6 Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-DeleteServersTestJSON-1895403467-project Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:49.411793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '2c7caaae-2b81-44c6-9fbb-a01d2af87b57'} Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:27:49.413205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:49.414488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:27:49.417087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-89f399ec-9ce4-4c83-8c92-954840d14bb1 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Returning 404 to user: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:27:49.418093 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-89f399ec-9ce4-4c83-8c92-954840d14bb1 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 404 len: 111 microversion: 2.1 time: 0.081989 Jun 03 15:27:49.422299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 93/168] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:49 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:27:49.593457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5aefb7be-f707-4253-be63-0bdb2c930591 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:49.594376 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5aefb7be-f707-4253-be63-0bdb2c930591 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:49.601789 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5aefb7be-f707-4253-be63-0bdb2c930591 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:49.602403 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5aefb7be-f707-4253-be63-0bdb2c930591 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:49.603494 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5aefb7be-f707-4253-be63-0bdb2c930591 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:49.604131 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5aefb7be-f707-4253-be63-0bdb2c930591 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:49.619920 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-5aefb7be-f707-4253-be63-0bdb2c930591 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] HTTP exception thrown: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5aefb7be-f707-4253-be63-0bdb2c930591 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Request method failure captured: Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57/os-volume_attachments HTTP/1.1 Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimigrMe2AzF3iMyQ04EQR_t_BAkXli_s0-UMa5Wkm6W7cxtkBoUqS4S7gvGw6WFtCF2PuFVw8jkswPF0_PdS7hnEU0HM3bxnokdjEcL9w5ZAbSUoSBknTGxD14jVXFK-F7VDApDwkPB-8sDa9CZSRRtRpPrwbHfetwJ6176sbcA7AwdY Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 683acaeef18d43b4ac3daeb60e3a8aea Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:27:49.625053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/683acaeef18d43b4ac3daeb60e3a8aea"}]}] Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 683acaeef18d43b4ac3daeb60e3a8aea Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-DeleteServersTestJSON-1895403467-project Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: bdd62219456547db82c2f5416d4f44f6 Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-DeleteServersTestJSON-1895403467-project Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:49.626460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'server_id': '2c7caaae-2b81-44c6-9fbb-a01d2af87b57'} Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:27:49.627238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:49.628460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:27:49.630561 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5aefb7be-f707-4253-be63-0bdb2c930591 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Returning 404 to user: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:27:49.631648 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5aefb7be-f707-4253-be63-0bdb2c930591 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042196 Jun 03 15:27:49.636501 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 76/169] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:27:49 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:27:49.650722 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4e69d08e-79ce-48bb-ab45-ff53964b68a5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:49.651339 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4e69d08e-79ce-48bb-ab45-ff53964b68a5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:49.664628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4e69d08e-79ce-48bb-ab45-ff53964b68a5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:49.664985 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4e69d08e-79ce-48bb-ab45-ff53964b68a5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:49.667388 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4e69d08e-79ce-48bb-ab45-ff53964b68a5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:49.668014 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4e69d08e-79ce-48bb-ab45-ff53964b68a5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:49.971795 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4e69d08e-79ce-48bb-ab45-ff53964b68a5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:49.985408 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4e69d08e-79ce-48bb-ab45-ff53964b68a5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.340136 Jun 03 15:27:49.998247 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 94/170] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:49 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:51.002424 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f17f79e4-8ec8-460d-9a0d-5275f90ee7ec tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:51.003354 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f17f79e4-8ec8-460d-9a0d-5275f90ee7ec tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:51.017926 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f17f79e4-8ec8-460d-9a0d-5275f90ee7ec tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:51.018296 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f17f79e4-8ec8-460d-9a0d-5275f90ee7ec tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:51.022479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f17f79e4-8ec8-460d-9a0d-5275f90ee7ec tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:51.022964 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f17f79e4-8ec8-460d-9a0d-5275f90ee7ec tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:51.331268 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f17f79e4-8ec8-460d-9a0d-5275f90ee7ec tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:51.345174 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f17f79e4-8ec8-460d-9a0d-5275f90ee7ec tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.343002 Jun 03 15:27:51.346103 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 77/171] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:50 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:52.364375 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bf1b907f-92be-4135-9fb4-206966dce786 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:52.366272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-bf1b907f-92be-4135-9fb4-206966dce786 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:52.373684 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bf1b907f-92be-4135-9fb4-206966dce786 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:52.374569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bf1b907f-92be-4135-9fb4-206966dce786 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:52.375537 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bf1b907f-92be-4135-9fb4-206966dce786 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:52.376177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bf1b907f-92be-4135-9fb4-206966dce786 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:52.550787 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-bf1b907f-92be-4135-9fb4-206966dce786 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:52.572292 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-bf1b907f-92be-4135-9fb4-206966dce786 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.210977 Jun 03 15:27:52.574235 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 95/172] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:52 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:53.599256 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ab19908b-dae2-4d1f-a9d3-ddb3c9fe3334 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:53.600340 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ab19908b-dae2-4d1f-a9d3-ddb3c9fe3334 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:53.609758 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ab19908b-dae2-4d1f-a9d3-ddb3c9fe3334 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:53.610452 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ab19908b-dae2-4d1f-a9d3-ddb3c9fe3334 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:53.611252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ab19908b-dae2-4d1f-a9d3-ddb3c9fe3334 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:53.611713 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ab19908b-dae2-4d1f-a9d3-ddb3c9fe3334 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:53.912223 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ab19908b-dae2-4d1f-a9d3-ddb3c9fe3334 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:53.925273 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ab19908b-dae2-4d1f-a9d3-ddb3c9fe3334 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.330011 Jun 03 15:27:53.925881 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 78/173] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:53 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:54.292932 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-756501c2-404b-4d32-a1c6-3e825289f036 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:54.293436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-756501c2-404b-4d32-a1c6-3e825289f036 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:54.298996 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=86 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:27:54.301053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-756501c2-404b-4d32-a1c6-3e825289f036 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:54.301499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-756501c2-404b-4d32-a1c6-3e825289f036 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:54.310057 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-756501c2-404b-4d32-a1c6-3e825289f036 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:54.310899 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-756501c2-404b-4d32-a1c6-3e825289f036 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:54.334560 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-756501c2-404b-4d32-a1c6-3e825289f036 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] HTTP exception thrown: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-756501c2-404b-4d32-a1c6-3e825289f036 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Request method failure captured: Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: DELETE /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 HTTP/1.1 Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigrMe2AzF3iMyQ04EQR_t_BAkXli_s0-UMa5Wkm6W7cxtkBoUqS4S7gvGw6WFtCF2PuFVw8jkswPF0_PdS7hnEU0HM3bxnokdjEcL9w5ZAbSUoSBknTGxD14jVXFK-F7VDApDwkPB-8sDa9CZSRRtRpPrwbHfetwJ6176sbcA7AwdY Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 683acaeef18d43b4ac3daeb60e3a8aea Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:27:54.336478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/683acaeef18d43b4ac3daeb60e3a8aea"}]}] Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 683acaeef18d43b4ac3daeb60e3a8aea Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-DeleteServersTestJSON-1895403467-project Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: bdd62219456547db82c2f5416d4f44f6 Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-DeleteServersTestJSON-1895403467-project Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:54.337765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '2c7caaae-2b81-44c6-9fbb-a01d2af87b57'} Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:27:54.338435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:54.339588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:27:54.340660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-756501c2-404b-4d32-a1c6-3e825289f036 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Returning 404 to user: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:27:54.340660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-756501c2-404b-4d32-a1c6-3e825289f036 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 404 len: 111 microversion: 2.1 time: 0.049370 Jun 03 15:27:54.340660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 96/174] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:27:54 2022] DELETE /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:27:54.346246 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cabcdd1c-2c05-4958-bbf6-e083e9503b79 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:54.347047 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-cabcdd1c-2c05-4958-bbf6-e083e9503b79 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] [instance: 2c7caaae-2b81-44c6-9fbb-a01d2af87b57] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:54.354293 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cabcdd1c-2c05-4958-bbf6-e083e9503b79 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:54.354779 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cabcdd1c-2c05-4958-bbf6-e083e9503b79 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:54.355574 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cabcdd1c-2c05-4958-bbf6-e083e9503b79 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:54.356012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cabcdd1c-2c05-4958-bbf6-e083e9503b79 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:54.375201 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-cabcdd1c-2c05-4958-bbf6-e083e9503b79 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] HTTP exception thrown: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cabcdd1c-2c05-4958-bbf6-e083e9503b79 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Request method failure captured: Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 HTTP/1.1 Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimigrMe2AzF3iMyQ04EQR_t_BAkXli_s0-UMa5Wkm6W7cxtkBoUqS4S7gvGw6WFtCF2PuFVw8jkswPF0_PdS7hnEU0HM3bxnokdjEcL9w5ZAbSUoSBknTGxD14jVXFK-F7VDApDwkPB-8sDa9CZSRRtRpPrwbHfetwJ6176sbcA7AwdY Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 683acaeef18d43b4ac3daeb60e3a8aea Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:27:54.377471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_683acaeef18d43b4ac3daeb60e3a8aea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/683acaeef18d43b4ac3daeb60e3a8aea"}]}] Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 683acaeef18d43b4ac3daeb60e3a8aea Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-DeleteServersTestJSON-1895403467 Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-DeleteServersTestJSON-1895403467-project Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: bdd62219456547db82c2f5416d4f44f6 Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-DeleteServersTestJSON-1895403467-project Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:54.378818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '2c7caaae-2b81-44c6-9fbb-a01d2af87b57'} Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:27:54.383027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. Jun 03 15:27:54.385262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:27:54.386259 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cabcdd1c-2c05-4958-bbf6-e083e9503b79 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] Returning 404 to user: Instance 2c7caaae-2b81-44c6-9fbb-a01d2af87b57 could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:27:54.386259 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-cabcdd1c-2c05-4958-bbf6-e083e9503b79 tempest-DeleteServersTestJSON-1895403467 tempest-DeleteServersTestJSON-1895403467-project] 10.222.0.93 "GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57" status: 404 len: 111 microversion: 2.1 time: 0.036502 Jun 03 15:27:54.386259 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 79/175] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:54 2022] GET /compute/v2.1/servers/2c7caaae-2b81-44c6-9fbb-a01d2af87b57 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:27:54.943222 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-39d0bd43-d85c-46f8-b5a7-2d62aa1adf6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:54.944442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-39d0bd43-d85c-46f8-b5a7-2d62aa1adf6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:54.953474 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-39d0bd43-d85c-46f8-b5a7-2d62aa1adf6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:54.954035 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-39d0bd43-d85c-46f8-b5a7-2d62aa1adf6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:54.955055 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-39d0bd43-d85c-46f8-b5a7-2d62aa1adf6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:54.955691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-39d0bd43-d85c-46f8-b5a7-2d62aa1adf6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:55.214154 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-39d0bd43-d85c-46f8-b5a7-2d62aa1adf6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:55.223488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-39d0bd43-d85c-46f8-b5a7-2d62aa1adf6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.284099 Jun 03 15:27:55.225266 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 97/176] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:54 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:56.241807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b6a8b564-17c9-42c3-bb96-d1b5304dbd87 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:56.242378 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b6a8b564-17c9-42c3-bb96-d1b5304dbd87 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:56.248780 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b6a8b564-17c9-42c3-bb96-d1b5304dbd87 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:56.249475 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b6a8b564-17c9-42c3-bb96-d1b5304dbd87 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:56.250438 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b6a8b564-17c9-42c3-bb96-d1b5304dbd87 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:56.251056 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b6a8b564-17c9-42c3-bb96-d1b5304dbd87 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:56.455490 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b6a8b564-17c9-42c3-bb96-d1b5304dbd87 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:56.465566 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b6a8b564-17c9-42c3-bb96-d1b5304dbd87 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.228137 Jun 03 15:27:56.479572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 80/177] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:56 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:57.307551 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5e150ecd-7e96-48f0-9593-32b75ac0b156 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Action: 'create', calling method: .version_select at 0x7f92f0ea6700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-26781627"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:57.493367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-923a0c1f-3f2c-4a11-a587-ae9eb14bc8f2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:57.495731 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-923a0c1f-3f2c-4a11-a587-ae9eb14bc8f2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:57.520231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-923a0c1f-3f2c-4a11-a587-ae9eb14bc8f2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:57.525594 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-923a0c1f-3f2c-4a11-a587-ae9eb14bc8f2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:57.527223 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-923a0c1f-3f2c-4a11-a587-ae9eb14bc8f2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:57.528121 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-923a0c1f-3f2c-4a11-a587-ae9eb14bc8f2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:57.854703 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-923a0c1f-3f2c-4a11-a587-ae9eb14bc8f2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:57.877014 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-923a0c1f-3f2c-4a11-a587-ae9eb14bc8f2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.390552 Jun 03 15:27:57.897030 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 81/178] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:57 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:58.046014 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5e150ecd-7e96-48f0-9593-32b75ac0b156 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 1.011760 Jun 03 15:27:58.046842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 98/179] 10.222.0.93 () {60 vars in 1154 bytes} [Fri Jun 3 15:27:57 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 1013 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 15:27:58.060847 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8a9e804f-1946-4dd8-b357-ce3bd02ba7ad tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f0f13ca0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:58.121945 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8a9e804f-1946-4dd8-b357-ce3bd02ba7ad tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597" status: 200 len: 343 microversion: 2.1 time: 0.067066 Jun 03 15:27:58.122970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 82/180] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:27:58 2022] GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:58.894585 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-29bb84fa-8a9a-4b59-85a2-ebbc6c21ce4a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:58.895217 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-29bb84fa-8a9a-4b59-85a2-ebbc6c21ce4a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:27:58.907496 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-29bb84fa-8a9a-4b59-85a2-ebbc6c21ce4a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:58.908230 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-29bb84fa-8a9a-4b59-85a2-ebbc6c21ce4a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:58.909164 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-29bb84fa-8a9a-4b59-85a2-ebbc6c21ce4a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:27:58.909748 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-29bb84fa-8a9a-4b59-85a2-ebbc6c21ce4a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:27:59.099415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-29bb84fa-8a9a-4b59-85a2-ebbc6c21ce4a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:27:59.131820 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-29bb84fa-8a9a-4b59-85a2-ebbc6c21ce4a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.236207 Jun 03 15:27:59.137668 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5b842831-c9d3-475d-adf3-2359283be4a3 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f0f131f0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:59.145937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 99/181] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:27:58 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:27:59.207555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5b842831-c9d3-475d-adf3-2359283be4a3 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597" status: 200 len: 344 microversion: 2.1 time: 0.074939 Jun 03 15:27:59.214419 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 83/182] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:27:59 2022] GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:59.222449 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c6a60380-1853-4835-8b78-70905fe7c5cc tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Action: 'create', calling method: .version_select at 0x7f92f0ea65e0>, body: {"snapshot": {"volume_id": "05689b0d-d3e8-4a40-87d9-7ecdf0fdf597", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1041786572"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:27:59.471372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c6a60380-1853-4835-8b78-70905fe7c5cc tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.253744 Jun 03 15:27:59.482416 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4af18223-7a0a-4963-b33c-1f2670591853 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f1082700>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:59.482871 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 100/183] 10.222.0.93 () {60 vars in 1161 bytes} [Fri Jun 3 15:27:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:59.537253 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4af18223-7a0a-4963-b33c-1f2670591853 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c" status: 200 len: 287 microversion: 2.1 time: 0.058153 Jun 03 15:27:59.537854 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 84/184] 10.222.0.93 () {58 vars in 1250 bytes} [Fri Jun 3 15:27:59 2022] GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:59.547880 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d9d64ff9-af93-4f79-a45c-d24312c3824d tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f0e77c10>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:59.603131 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d9d64ff9-af93-4f79-a45c-d24312c3824d tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.059494 Jun 03 15:27:59.612779 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 101/185] 10.222.0.93 () {58 vars in 1139 bytes} [Fri Jun 3 15:27:59 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:27:59.614377 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-033b4616-cd20-4b39-b2da-4a21002cd724 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f0ffdca0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:27:59.653523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-033b4616-cd20-4b39-b2da-4a21002cd724 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c" status: 200 len: 287 microversion: 2.1 time: 0.042939 Jun 03 15:27:59.654218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 85/186] 10.222.0.93 () {58 vars in 1250 bytes} [Fri Jun 3 15:27:59 2022] GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:00.150360 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-83f2f1fa-6b88-415a-93ab-d4755fce9d3e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:00.151758 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-83f2f1fa-6b88-415a-93ab-d4755fce9d3e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:00.164518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-83f2f1fa-6b88-415a-93ab-d4755fce9d3e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:00.165372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-83f2f1fa-6b88-415a-93ab-d4755fce9d3e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:00.168683 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-83f2f1fa-6b88-415a-93ab-d4755fce9d3e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:00.169552 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-83f2f1fa-6b88-415a-93ab-d4755fce9d3e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:00.418433 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-83f2f1fa-6b88-415a-93ab-d4755fce9d3e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:00.429340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-83f2f1fa-6b88-415a-93ab-d4755fce9d3e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.283735 Jun 03 15:28:00.430235 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 102/187] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:00 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:00.689402 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a5b2a30c-f829-4049-b466-8fdc15ef48d2 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f0f13790>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:00.725392 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a5b2a30c-f829-4049-b466-8fdc15ef48d2 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c" status: 200 len: 287 microversion: 2.1 time: 0.050196 Jun 03 15:28:00.726574 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 86/188] 10.222.0.93 () {58 vars in 1250 bytes} [Fri Jun 3 15:28:00 2022] GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:01.445408 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b897fc92-d601-4772-8558-e17e7b64efdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:01.446200 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b897fc92-d601-4772-8558-e17e7b64efdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:01.453944 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b897fc92-d601-4772-8558-e17e7b64efdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:01.454405 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b897fc92-d601-4772-8558-e17e7b64efdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:01.455244 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b897fc92-d601-4772-8558-e17e7b64efdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:01.455682 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b897fc92-d601-4772-8558-e17e7b64efdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:01.695881 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b897fc92-d601-4772-8558-e17e7b64efdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:01.710029 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b897fc92-d601-4772-8558-e17e7b64efdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.268636 Jun 03 15:28:01.719667 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 103/189] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:01 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:01.737749 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b6466406-6619-46a7-a2d3-f6fc23a9d218 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f10b18b0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:01.789251 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b6466406-6619-46a7-a2d3-f6fc23a9d218 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c" status: 200 len: 287 microversion: 2.1 time: 0.055188 Jun 03 15:28:01.790173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 87/190] 10.222.0.93 () {58 vars in 1250 bytes} [Fri Jun 3 15:28:01 2022] GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:01.813788 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-19c9e29c-50e2-45cd-a36a-017843e78c9e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Action: 'create', calling method: .version_select at 0x7f92f0ea6550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-674887491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQhdUEoyyRgOWiHwF8mmD5/0Hj1zOeFRkJBEgJrLhR7Ndfx3IDfxHjFCZgo6fEf+8jZOf9+mWDiwsOsh5rsJSVnm16G+ld662BjIkVgtR0xcozjIZq1yX3Uk3ieFq7Veg=="}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:01.832239 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-19c9e29c-50e2-45cd-a36a-017843e78c9e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Getting quotas for project 00d2022cc4be4779af1edf1520c439ae. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:28:01.837862 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-19c9e29c-50e2-45cd-a36a-017843e78c9e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Getting quotas for user dac7f01263374a2cbdd892a2513f5ecd and project 00d2022cc4be4779af1edf1520c439ae. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:28:01.864874 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-19c9e29c-50e2-45cd-a36a-017843e78c9e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055337 Jun 03 15:28:01.865870 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 104/191] 10.222.0.93 () {60 vars in 1158 bytes} [Fri Jun 3 15:28:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:01.975589 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-237175812", "imageRef": "9f778d21-0b1a-4f9b-9997-4509a09752f5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-674887491", "networks": [{"uuid": "beafa1b9-ad41-4519-b3bd-aaad5165f1e2"}]}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:01.982932 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:02.042816 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] validate_networks() for [('beafa1b9-ad41-4519-b3bd-aaad5165f1e2', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:28:02.600070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:28:02.600768 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:28:02.601375 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:28:02.601958 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:28:02.603043 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:28:02.612699 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:02.613387 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:02.614336 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:02.615499 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:02.640543 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Getting quotas for project 00d2022cc4be4779af1edf1520c439ae. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:28:02.644781 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Getting quotas for user dac7f01263374a2cbdd892a2513f5ecd and project 00d2022cc4be4779af1edf1520c439ae. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:28:02.657111 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:28:02.659674 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f778d21-0b1a-4f9b-9997-4509a09752f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:28:02.727221 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f21019cb-cf21-4d12-ad75-735a7746cf7b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:02.728415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f21019cb-cf21-4d12-ad75-735a7746cf7b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:02.735234 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f21019cb-cf21-4d12-ad75-735a7746cf7b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:02.735954 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f21019cb-cf21-4d12-ad75-735a7746cf7b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:02.736888 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f21019cb-cf21-4d12-ad75-735a7746cf7b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:02.737478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f21019cb-cf21-4d12-ad75-735a7746cf7b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:02.740522 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e761311a-3135-4602-a0e5-89672fe3a300 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762099 Jun 03 15:28:02.745874 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 88/192] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:28:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:28:02.768329 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-07231a6b-24b7-47d5-be7c-8a29bdc37c49 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:02.768951 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-07231a6b-24b7-47d5-be7c-8a29bdc37c49 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:02.854336 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-07231a6b-24b7-47d5-be7c-8a29bdc37c49 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:02.864222 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-07231a6b-24b7-47d5-be7c-8a29bdc37c49 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1257 microversion: 2.1 time: 0.116161 Jun 03 15:28:02.877655 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 89/193] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:02 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1257 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:02.887395 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9360448e-a2e8-4d72-bf9e-62cc38243473 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f0f13e50>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:02.940579 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9360448e-a2e8-4d72-bf9e-62cc38243473 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c" status: 200 len: 288 microversion: 2.1 time: 0.061506 Jun 03 15:28:02.946332 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 90/194] 10.222.0.93 () {58 vars in 1250 bytes} [Fri Jun 3 15:28:02 2022] GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c => generated 288 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:02.977399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f6fe2400-66ba-4a68-89d2-63418d2c551d tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f10b1c10>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:03.030194 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f21019cb-cf21-4d12-ad75-735a7746cf7b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:03.043334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f21019cb-cf21-4d12-ad75-735a7746cf7b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.319278 Jun 03 15:28:03.043933 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 105/195] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:02 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:03.105302 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f6fe2400-66ba-4a68-89d2-63418d2c551d tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "DELETE /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c" status: 202 len: 0 microversion: 2.1 time: 0.139932 Jun 03 15:28:03.106374 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 91/196] 10.222.0.93 () {58 vars in 1253 bytes} [Fri Jun 3 15:28:02 2022] DELETE /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:28:03.121131 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-393983d0-7940-47a1-ad09-a51f63816b97 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f1049700>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:03.181579 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-393983d0-7940-47a1-ad09-a51f63816b97 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c" status: 200 len: 287 microversion: 2.1 time: 0.071032 Jun 03 15:28:03.186734 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 106/197] 10.222.0.93 () {58 vars in 1250 bytes} [Fri Jun 3 15:28:03 2022] GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:03.884948 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-da4926cb-298e-48c0-a93c-1e8f1c2ce906 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:03.885628 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-da4926cb-298e-48c0-a93c-1e8f1c2ce906 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:03.898314 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-da4926cb-298e-48c0-a93c-1e8f1c2ce906 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:03.898879 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-da4926cb-298e-48c0-a93c-1e8f1c2ce906 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:03.899776 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-da4926cb-298e-48c0-a93c-1e8f1c2ce906 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:03.900410 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-da4926cb-298e-48c0-a93c-1e8f1c2ce906 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:03.995163 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-da4926cb-298e-48c0-a93c-1e8f1c2ce906 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:04.008491 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-da4926cb-298e-48c0-a93c-1e8f1c2ce906 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1309 microversion: 2.1 time: 0.129827 Jun 03 15:28:04.015327 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 92/198] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:03 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1309 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:04.061585 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0fd42fb8-e439-4104-805f-067a53c1b187 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:04.062883 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0fd42fb8-e439-4104-805f-067a53c1b187 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:04.069487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0fd42fb8-e439-4104-805f-067a53c1b187 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:04.069934 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0fd42fb8-e439-4104-805f-067a53c1b187 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:04.070744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0fd42fb8-e439-4104-805f-067a53c1b187 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:04.071476 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0fd42fb8-e439-4104-805f-067a53c1b187 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:04.195037 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6e600419-fd50-4e24-b6c5-ffc32f9cdb9a tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f10f1940>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:04.230470 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-6e600419-fd50-4e24-b6c5-ffc32f9cdb9a tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] HTTP exception thrown: Snapshot f61712bb-c65c-48e4-8660-f67748c7bb2c could not be found. Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6e600419-fd50-4e24-b6c5-ffc32f9cdb9a tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Request method failure captured: Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c HTTP/1.1 Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimih82lwYfj_HkNw-Vqj7KYTah9GvATk3hWccBALGfQsVxk24GRRORFxvImq3cM6PCsRvZd0azVT9xcgQmSxRbYdWTzfcgGl1o17j0BlHYibqHXCu0ErezgjcBQbISmOxy0IZBkqosLkaMxuJ5nLaZKaYZLblnskx6PMNtX6IAzC0sS4 Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 10c35bb9eda54d509901fab7285c40e0 Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:28:04.234888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c35bb9eda54d509901fab7285c40e0"}]}] Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 10c35bb9eda54d509901fab7285c40e0 Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-VolumesSnapshotsTestJSON-576715770-project Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 3dc72ca8fa3742e9a7d2e8bae7b992ae Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-VolumesSnapshotsTestJSON-576715770-project Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Snapshot f61712bb-c65c-48e4-8660-f67748c7bb2c could not be found. Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': 'f61712bb-c65c-48e4-8660-f67748c7bb2c'} Jun 03 15:28:04.236229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f61712bb-c65c-48e4-8660-f67748c7bb2c could not be found. (HTTP 404) (Request-ID: req-ac7b798a-048e-48dd-a5c3-4c14c33ca8d3) Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:28:04.237152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 15:28:04.238426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f61712bb-c65c-48e4-8660-f67748c7bb2c could not be found. Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 03 15:28:04.240399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f61712bb-c65c-48e4-8660-f67748c7bb2c could not be found. Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f61712bb-c65c-48e4-8660-f67748c7bb2c could not be found. Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6e600419-fd50-4e24-b6c5-ffc32f9cdb9a tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Returning 404 to user: Snapshot f61712bb-c65c-48e4-8660-f67748c7bb2c could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6e600419-fd50-4e24-b6c5-ffc32f9cdb9a tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c" status: 404 len: 111 microversion: 2.1 time: 0.046806 Jun 03 15:28:04.241686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 93/199] 10.222.0.93 () {58 vars in 1250 bytes} [Fri Jun 3 15:28:04 2022] GET /compute/v2.1/os-snapshots/f61712bb-c65c-48e4-8660-f67748c7bb2c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:28:04.248346 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-fb0214ad-77ff-4248-afaf-6ea31b153499 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f0ede5e0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:04.361229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-fb0214ad-77ff-4248-afaf-6ea31b153499 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597" status: 202 len: 0 microversion: 2.1 time: 0.117969 Jun 03 15:28:04.362074 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 94/200] 10.222.0.93 () {58 vars in 1247 bytes} [Fri Jun 3 15:28:04 2022] DELETE /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:28:04.375544 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2c0ee4a2-e2fd-4460-831f-1cc58399b6af tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f107bdc0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:04.457081 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2c0ee4a2-e2fd-4460-831f-1cc58399b6af tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597" status: 200 len: 343 microversion: 2.1 time: 0.089078 Jun 03 15:28:04.457650 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 95/201] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:28:04 2022] GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 => generated 343 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:04.471841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0fd42fb8-e439-4104-805f-067a53c1b187 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:04.489460 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0fd42fb8-e439-4104-805f-067a53c1b187 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.431697 Jun 03 15:28:04.491425 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 107/202] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:04 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:05.031575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8325389c-fb35-479a-be35-bb3a3e4c5166 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:05.032864 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8325389c-fb35-479a-be35-bb3a3e4c5166 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:05.049046 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8325389c-fb35-479a-be35-bb3a3e4c5166 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:05.049534 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8325389c-fb35-479a-be35-bb3a3e4c5166 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:05.051341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8325389c-fb35-479a-be35-bb3a3e4c5166 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:05.061631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8325389c-fb35-479a-be35-bb3a3e4c5166 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:05.191277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-8325389c-fb35-479a-be35-bb3a3e4c5166 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:05.194472 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:05.204823 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8325389c-fb35-479a-be35-bb3a3e4c5166 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1315 microversion: 2.1 time: 0.180499 Jun 03 15:28:05.205294 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 96/203] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:05 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:05.475741 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d9d84a29-9f15-414f-a411-75ea6279d0e4 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f0e77c10>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:05.509997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3230e2ac-a55b-43fa-b0a5-52b92919ac1c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:05.511197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3230e2ac-a55b-43fa-b0a5-52b92919ac1c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:05.545246 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3230e2ac-a55b-43fa-b0a5-52b92919ac1c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:05.545246 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3230e2ac-a55b-43fa-b0a5-52b92919ac1c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:05.545246 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3230e2ac-a55b-43fa-b0a5-52b92919ac1c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:05.545246 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3230e2ac-a55b-43fa-b0a5-52b92919ac1c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:05.560158 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-d9d84a29-9f15-414f-a411-75ea6279d0e4 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] HTTP exception thrown: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d9d84a29-9f15-414f-a411-75ea6279d0e4 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Request method failure captured: Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 HTTP/1.1 Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimih82lwYfj_HkNw-Vqj7KYTah9GvATk3hWccBALGfQsVxk24GRRORFxvImq3cM6PCsRvZd0azVT9xcgQmSxRbYdWTzfcgGl1o17j0BlHYibqHXCu0ErezgjcBQbISmOxy0IZBkqosLkaMxuJ5nLaZKaYZLblnskx6PMNtX6IAzC0sS4 Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 10c35bb9eda54d509901fab7285c40e0 Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:28:05.566133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c35bb9eda54d509901fab7285c40e0"}]}] Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 10c35bb9eda54d509901fab7285c40e0 Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesSnapshotsTestJSON-576715770-project Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 3dc72ca8fa3742e9a7d2e8bae7b992ae Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesSnapshotsTestJSON-576715770-project Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '05689b0d-d3e8-4a40-87d9-7ecdf0fdf597'} Jun 03 15:28:05.567483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. (HTTP 404) (Request-ID: req-e2465a15-d82c-4865-a076-0d3fafbc7860) Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:05.568739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 15:28:05.569742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 15:28:05.573060 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d9d84a29-9f15-414f-a411-75ea6279d0e4 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Returning 404 to user: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d9d84a29-9f15-414f-a411-75ea6279d0e4 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597" status: 404 len: 109 microversion: 2.1 time: 0.098337 Jun 03 15:28:05.575672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 108/204] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:28:05 2022] GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:28:05.579956 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-11915245-7dc3-4cf2-8875-d80b07360fbf tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f0ea6c10>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:05.694674 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-11915245-7dc3-4cf2-8875-d80b07360fbf tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] HTTP exception thrown: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-11915245-7dc3-4cf2-8875-d80b07360fbf tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Request method failure captured: Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: DELETE /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 HTTP/1.1 Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimih82lwYfj_HkNw-Vqj7KYTah9GvATk3hWccBALGfQsVxk24GRRORFxvImq3cM6PCsRvZd0azVT9xcgQmSxRbYdWTzfcgGl1o17j0BlHYibqHXCu0ErezgjcBQbISmOxy0IZBkqosLkaMxuJ5nLaZKaYZLblnskx6PMNtX6IAzC0sS4 Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 10c35bb9eda54d509901fab7285c40e0 Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:28:05.697812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c35bb9eda54d509901fab7285c40e0"}]}] Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 10c35bb9eda54d509901fab7285c40e0 Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesSnapshotsTestJSON-576715770-project Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 3dc72ca8fa3742e9a7d2e8bae7b992ae Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesSnapshotsTestJSON-576715770-project Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '05689b0d-d3e8-4a40-87d9-7ecdf0fdf597'} Jun 03 15:28:05.699340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. (HTTP 404) (Request-ID: req-eca4e032-7300-48aa-8230-5c6db6be8e2c) Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:05.700205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 15:28:05.701502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 15:28:05.702913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.704459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.706423 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-11915245-7dc3-4cf2-8875-d80b07360fbf tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Returning 404 to user: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:28:05.708020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-11915245-7dc3-4cf2-8875-d80b07360fbf tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597" status: 404 len: 109 microversion: 2.1 time: 0.131814 Jun 03 15:28:05.709880 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 109/205] 10.222.0.93 () {58 vars in 1247 bytes} [Fri Jun 3 15:28:05 2022] DELETE /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:28:05.731107 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ed419e62-1f7b-4814-9ad7-d49ac4ad0f68 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Calling method '.version_select at 0x7f92f0e77ca0>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:05.814014 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-ed419e62-1f7b-4814-9ad7-d49ac4ad0f68 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] HTTP exception thrown: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ed419e62-1f7b-4814-9ad7-d49ac4ad0f68 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Request method failure captured: Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 HTTP/1.1 Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimih82lwYfj_HkNw-Vqj7KYTah9GvATk3hWccBALGfQsVxk24GRRORFxvImq3cM6PCsRvZd0azVT9xcgQmSxRbYdWTzfcgGl1o17j0BlHYibqHXCu0ErezgjcBQbISmOxy0IZBkqosLkaMxuJ5nLaZKaYZLblnskx6PMNtX6IAzC0sS4 Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 10c35bb9eda54d509901fab7285c40e0 Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:28:05.816207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c35bb9eda54d509901fab7285c40e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c35bb9eda54d509901fab7285c40e0"}]}] Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 10c35bb9eda54d509901fab7285c40e0 Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-576715770 Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesSnapshotsTestJSON-576715770-project Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 3dc72ca8fa3742e9a7d2e8bae7b992ae Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesSnapshotsTestJSON-576715770-project Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '05689b0d-d3e8-4a40-87d9-7ecdf0fdf597'} Jun 03 15:28:05.818403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. (HTTP 404) (Request-ID: req-305b7fcd-ab4e-49e3-9e6d-7695d42ad372) Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:05.820565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 15:28:05.822189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 15:28:05.823437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. Jun 03 15:28:05.824705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:05.827192 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ed419e62-1f7b-4814-9ad7-d49ac4ad0f68 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] Returning 404 to user: Volume 05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:28:05.828257 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ed419e62-1f7b-4814-9ad7-d49ac4ad0f68 tempest-VolumesSnapshotsTestJSON-576715770 tempest-VolumesSnapshotsTestJSON-576715770-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597" status: 404 len: 109 microversion: 2.1 time: 0.113976 Jun 03 15:28:05.829101 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 110/206] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:28:05 2022] GET /compute/v2.1/os-volumes/05689b0d-d3e8-4a40-87d9-7ecdf0fdf597 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:28:06.015041 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3230e2ac-a55b-43fa-b0a5-52b92919ac1c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:06.034017 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3230e2ac-a55b-43fa-b0a5-52b92919ac1c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.526505 Jun 03 15:28:06.049435 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 97/207] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:05 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:06.226985 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e9acdd5f-756d-43c4-967d-9da5984f12c1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:06.228138 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e9acdd5f-756d-43c4-967d-9da5984f12c1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:06.263845 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e9acdd5f-756d-43c4-967d-9da5984f12c1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:06.267221 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e9acdd5f-756d-43c4-967d-9da5984f12c1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:06.270078 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e9acdd5f-756d-43c4-967d-9da5984f12c1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:06.274722 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e9acdd5f-756d-43c4-967d-9da5984f12c1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:06.591136 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e9acdd5f-756d-43c4-967d-9da5984f12c1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:06.602162 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e9acdd5f-756d-43c4-967d-9da5984f12c1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.381663 Jun 03 15:28:06.615433 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 111/208] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:06 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:07.069646 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6b0bc0b9-49af-46c0-90a5-b27a68a03cc0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:07.072136 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6b0bc0b9-49af-46c0-90a5-b27a68a03cc0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:07.110578 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6b0bc0b9-49af-46c0-90a5-b27a68a03cc0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:07.126606 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6b0bc0b9-49af-46c0-90a5-b27a68a03cc0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:07.129623 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6b0bc0b9-49af-46c0-90a5-b27a68a03cc0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:07.134392 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6b0bc0b9-49af-46c0-90a5-b27a68a03cc0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:07.464417 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6b0bc0b9-49af-46c0-90a5-b27a68a03cc0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:07.477434 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6b0bc0b9-49af-46c0-90a5-b27a68a03cc0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.415649 Jun 03 15:28:07.478266 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 98/209] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:07 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:07.639528 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5fde1307-db87-48c1-8dec-c4920f973ccc tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:07.640535 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5fde1307-db87-48c1-8dec-c4920f973ccc tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:07.654921 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5fde1307-db87-48c1-8dec-c4920f973ccc tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:07.656216 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5fde1307-db87-48c1-8dec-c4920f973ccc tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:07.657922 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5fde1307-db87-48c1-8dec-c4920f973ccc tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:07.658124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5fde1307-db87-48c1-8dec-c4920f973ccc tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:07.929541 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5fde1307-db87-48c1-8dec-c4920f973ccc tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:07.940127 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5fde1307-db87-48c1-8dec-c4920f973ccc tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.308010 Jun 03 15:28:07.941249 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 112/210] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:07 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:08.494307 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3ba2053e-52da-48a3-99b5-64e5c0558123 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:08.495057 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3ba2053e-52da-48a3-99b5-64e5c0558123 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:08.506374 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3ba2053e-52da-48a3-99b5-64e5c0558123 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:08.507925 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3ba2053e-52da-48a3-99b5-64e5c0558123 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:08.509541 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3ba2053e-52da-48a3-99b5-64e5c0558123 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:08.510836 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3ba2053e-52da-48a3-99b5-64e5c0558123 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:09.100678 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3ba2053e-52da-48a3-99b5-64e5c0558123 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:09.113158 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3ba2053e-52da-48a3-99b5-64e5c0558123 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.620355 Jun 03 15:28:09.126899 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 99/211] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:08 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:09.153817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-af836cb1-c0fe-4004-adfc-bce4568f2aa7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:09.160507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-af836cb1-c0fe-4004-adfc-bce4568f2aa7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:09.188346 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-af836cb1-c0fe-4004-adfc-bce4568f2aa7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:09.190216 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-af836cb1-c0fe-4004-adfc-bce4568f2aa7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:09.195289 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-af836cb1-c0fe-4004-adfc-bce4568f2aa7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:09.196050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-af836cb1-c0fe-4004-adfc-bce4568f2aa7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:09.314996 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d2707ef1-0bc2-4548-8c21-487cbdc98d7f tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] Action: 'create', calling method: .version_select at 0x7f92f0e9caf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1263211261", "metadata": {"Type": "work"}}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:09.859560 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-af836cb1-c0fe-4004-adfc-bce4568f2aa7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:09.874822 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-af836cb1-c0fe-4004-adfc-bce4568f2aa7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.743645 Jun 03 15:28:09.875658 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 100/212] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:09 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:09.931086 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d2707ef1-0bc2-4548-8c21-487cbdc98d7f tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.024205 Jun 03 15:28:09.932287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 113/213] 10.222.0.93 () {60 vars in 1155 bytes} [Fri Jun 3 15:28:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1026 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 03 15:28:09.950371 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-20559a18-343e-4a16-b0ae-8f009152c86b tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] Calling method '.version_select at 0x7f92f0f13b80>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:10.062811 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-20559a18-343e-4a16-b0ae-8f009152c86b tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439" status: 200 len: 353 microversion: 2.1 time: 0.123659 Jun 03 15:28:10.063900 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 101/214] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:28:09 2022] GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:28:10.134867 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8d3bb21e-d95f-48a1-905d-4fe7d720e0bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:10.135628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8d3bb21e-d95f-48a1-905d-4fe7d720e0bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:10.142412 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8d3bb21e-d95f-48a1-905d-4fe7d720e0bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:10.143263 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8d3bb21e-d95f-48a1-905d-4fe7d720e0bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:10.144299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8d3bb21e-d95f-48a1-905d-4fe7d720e0bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:10.144846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8d3bb21e-d95f-48a1-905d-4fe7d720e0bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:10.497794 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8d3bb21e-d95f-48a1-905d-4fe7d720e0bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:10.509280 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8d3bb21e-d95f-48a1-905d-4fe7d720e0bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.379059 Jun 03 15:28:10.509887 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 114/215] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:10 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:10.893911 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-98110a1e-7abd-4c6b-95e7-13cde7c225f3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:10.894521 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-98110a1e-7abd-4c6b-95e7-13cde7c225f3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:10.903064 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98110a1e-7abd-4c6b-95e7-13cde7c225f3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:10.903912 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98110a1e-7abd-4c6b-95e7-13cde7c225f3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:10.904957 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98110a1e-7abd-4c6b-95e7-13cde7c225f3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:10.914351 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98110a1e-7abd-4c6b-95e7-13cde7c225f3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:11.076564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f8c548e8-3b94-44e0-8912-f33aa938ed5f tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] Calling method '.version_select at 0x7f92f0e9c940>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:11.175321 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f8c548e8-3b94-44e0-8912-f33aa938ed5f tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439" status: 200 len: 354 microversion: 2.1 time: 0.102581 Jun 03 15:28:11.176201 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 115/216] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:28:11 2022] GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:11.189365 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7db5fe56-bf9c-45c2-8cc3-0fa883fe4862 tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] Calling method '.version_select at 0x7f92f10499d0>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:11.254558 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7db5fe56-bf9c-45c2-8cc3-0fa883fe4862 tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439" status: 200 len: 354 microversion: 2.1 time: 0.069196 Jun 03 15:28:11.256281 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 116/217] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:28:11 2022] GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439 => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:11.279053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-347276f9-2e5a-44ef-948b-85ea0cd9593c tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] Calling method '.version_select at 0x7f92f10fb670>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:11.298918 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-98110a1e-7abd-4c6b-95e7-13cde7c225f3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:11.319626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-98110a1e-7abd-4c6b-95e7-13cde7c225f3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.430880 Jun 03 15:28:11.322241 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 102/218] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:10 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:11.418066 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-347276f9-2e5a-44ef-948b-85ea0cd9593c tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439" status: 202 len: 0 microversion: 2.1 time: 0.144964 Jun 03 15:28:11.427609 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-82c0a141-0b4d-49c2-9f42-cf8217ea594f tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] Calling method '.version_select at 0x7f92f0ef7790>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:11.428259 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 117/219] 10.222.0.93 () {58 vars in 1247 bytes} [Fri Jun 3 15:28:11 2022] DELETE /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 15:28:11.487998 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-82c0a141-0b4d-49c2-9f42-cf8217ea594f tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439" status: 200 len: 353 microversion: 2.1 time: 0.064845 Jun 03 15:28:11.493997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 103/220] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:28:11 2022] GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439 => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:11.528028 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2a546200-a9f8-4a91-a84d-36cdc7ca80be tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:11.529838 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2a546200-a9f8-4a91-a84d-36cdc7ca80be tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:11.550436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a546200-a9f8-4a91-a84d-36cdc7ca80be tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:11.554430 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a546200-a9f8-4a91-a84d-36cdc7ca80be tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:11.558021 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a546200-a9f8-4a91-a84d-36cdc7ca80be tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:11.558743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a546200-a9f8-4a91-a84d-36cdc7ca80be tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:11.848671 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=4 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:12.257849 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2a546200-a9f8-4a91-a84d-36cdc7ca80be tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:12.273838 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2a546200-a9f8-4a91-a84d-36cdc7ca80be tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.749784 Jun 03 15:28:12.277172 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 118/221] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:11 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:12.342922 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-bd04f7d0-57ab-466d-8149-1569470168ac tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:12.343642 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-bd04f7d0-57ab-466d-8149-1569470168ac tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:12.364254 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bd04f7d0-57ab-466d-8149-1569470168ac tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:12.365562 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bd04f7d0-57ab-466d-8149-1569470168ac tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:12.368526 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bd04f7d0-57ab-466d-8149-1569470168ac tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:12.368987 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bd04f7d0-57ab-466d-8149-1569470168ac tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:12.502490 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ec1ad7fb-ed0a-413f-a642-d4fb09037801 tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] Calling method '.version_select at 0x7f92f11129d0>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:12.594271 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-ec1ad7fb-ed0a-413f-a642-d4fb09037801 tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] HTTP exception thrown: Volume 50f0cf99-c8b8-4d8f-aec5-862c63061439 could not be found. Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ec1ad7fb-ed0a-413f-a642-d4fb09037801 tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] Request method failure captured: Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439 HTTP/1.1 Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimiiIvSf_YxkV33eBENqeslDM3TRTIgAkMH3fznsBaM20FeBo7rl-ETfSeDGMOLK6zm5N2DFxR3SlVQu_Za3AnFMkbgMn2OwskRQTvENA9fSX0we8kwGOE0Qy2RZL1XDRSvSRjzWs0vMd4cWVSEBKdl7sMs9ZNLMIrz6ouSsvI6uxyQk Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 123c9ca329dd4d2699241875f2720ac3 Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesGetTestJSON-1885658490 Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:28:12.596572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/123c9ca329dd4d2699241875f2720ac3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/123c9ca329dd4d2699241875f2720ac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_123c9ca329dd4d2699241875f2720ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/123c9ca329dd4d2699241875f2720ac3"}]}] Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesGetTestJSON-1885658490 Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 123c9ca329dd4d2699241875f2720ac3 Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesGetTestJSON-1885658490 Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesGetTestJSON-1885658490-project Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 4b4fe74771ee43e7b74a7784dc1cdbe5 Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesGetTestJSON-1885658490-project Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Volume 50f0cf99-c8b8-4d8f-aec5-862c63061439 could not be found. Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '50f0cf99-c8b8-4d8f-aec5-862c63061439'} Jun 03 15:28:12.597790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50f0cf99-c8b8-4d8f-aec5-862c63061439 could not be found. (HTTP 404) (Request-ID: req-6381a902-362a-4a2b-ad85-faabd4fe9673) Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:12.598633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 15:28:12.599865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50f0cf99-c8b8-4d8f-aec5-862c63061439 could not be found. Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 15:28:12.600855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50f0cf99-c8b8-4d8f-aec5-862c63061439 could not be found. Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50f0cf99-c8b8-4d8f-aec5-862c63061439 could not be found. Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ec1ad7fb-ed0a-413f-a642-d4fb09037801 tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] Returning 404 to user: Volume 50f0cf99-c8b8-4d8f-aec5-862c63061439 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ec1ad7fb-ed0a-413f-a642-d4fb09037801 tempest-VolumesGetTestJSON-1885658490 tempest-VolumesGetTestJSON-1885658490-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439" status: 404 len: 109 microversion: 2.1 time: 0.099811 Jun 03 15:28:12.603693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 119/222] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:28:12 2022] GET /compute/v2.1/os-volumes/50f0cf99-c8b8-4d8f-aec5-862c63061439 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:28:12.628712 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:12.871344 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=8 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:13.061975 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-bd04f7d0-57ab-466d-8149-1569470168ac tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:13.078224 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-bd04f7d0-57ab-466d-8149-1569470168ac tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.739672 Jun 03 15:28:13.092568 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 104/223] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:12 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:13.292403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c68c3aaf-9006-4440-8535-cf01e6ab8cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:13.293126 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c68c3aaf-9006-4440-8535-cf01e6ab8cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:13.306385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c68c3aaf-9006-4440-8535-cf01e6ab8cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:13.320599 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c68c3aaf-9006-4440-8535-cf01e6ab8cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:13.321988 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c68c3aaf-9006-4440-8535-cf01e6ab8cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:13.322746 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c68c3aaf-9006-4440-8535-cf01e6ab8cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:14.103583 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a4759f81-270e-46f2-bc20-61ec3cda9ab2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:14.105481 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a4759f81-270e-46f2-bc20-61ec3cda9ab2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:14.122616 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a4759f81-270e-46f2-bc20-61ec3cda9ab2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:14.123143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a4759f81-270e-46f2-bc20-61ec3cda9ab2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:14.124222 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a4759f81-270e-46f2-bc20-61ec3cda9ab2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:14.124663 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a4759f81-270e-46f2-bc20-61ec3cda9ab2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:14.209659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c68c3aaf-9006-4440-8535-cf01e6ab8cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:14.223667 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c68c3aaf-9006-4440-8535-cf01e6ab8cb4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.936048 Jun 03 15:28:14.224745 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 120/224] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:13 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:14.644540 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a4759f81-270e-46f2-bc20-61ec3cda9ab2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:14.658824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a4759f81-270e-46f2-bc20-61ec3cda9ab2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.565066 Jun 03 15:28:14.679280 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 105/225] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:14 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:15.242008 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-317c91bd-9358-4da1-9f15-3b01314ba416 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:15.242751 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-317c91bd-9358-4da1-9f15-3b01314ba416 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:15.268302 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-317c91bd-9358-4da1-9f15-3b01314ba416 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:15.270650 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-317c91bd-9358-4da1-9f15-3b01314ba416 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:15.275764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-317c91bd-9358-4da1-9f15-3b01314ba416 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:15.277876 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-317c91bd-9358-4da1-9f15-3b01314ba416 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:15.696887 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4eed31fd-006c-445d-aecc-4db9b51a38e5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:15.697665 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4eed31fd-006c-445d-aecc-4db9b51a38e5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:15.715864 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4eed31fd-006c-445d-aecc-4db9b51a38e5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:15.716317 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4eed31fd-006c-445d-aecc-4db9b51a38e5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:15.717108 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4eed31fd-006c-445d-aecc-4db9b51a38e5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:15.717541 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4eed31fd-006c-445d-aecc-4db9b51a38e5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:16.403499 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4eed31fd-006c-445d-aecc-4db9b51a38e5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:16.417358 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4eed31fd-006c-445d-aecc-4db9b51a38e5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.724790 Jun 03 15:28:16.424095 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 106/226] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:15 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:16.715135 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-317c91bd-9358-4da1-9f15-3b01314ba416 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:16.740169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-317c91bd-9358-4da1-9f15-3b01314ba416 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 1.503723 Jun 03 15:28:16.741810 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 121/227] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:15 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:17.442270 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-500454e5-c292-4678-af84-4a3e93160a75 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:17.442999 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-500454e5-c292-4678-af84-4a3e93160a75 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:17.471214 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-500454e5-c292-4678-af84-4a3e93160a75 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:17.474472 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-500454e5-c292-4678-af84-4a3e93160a75 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:17.479267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-500454e5-c292-4678-af84-4a3e93160a75 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:17.481593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-500454e5-c292-4678-af84-4a3e93160a75 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:17.878937 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-500454e5-c292-4678-af84-4a3e93160a75 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:17.887854 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-500454e5-c292-4678-af84-4a3e93160a75 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.450312 Jun 03 15:28:17.890997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 107/228] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:17 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:17.907515 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-bf5a7ea2-ccda-4a05-9903-c209247bd6f8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:17.910152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-bf5a7ea2-ccda-4a05-9903-c209247bd6f8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:17.924050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bf5a7ea2-ccda-4a05-9903-c209247bd6f8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:17.924508 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bf5a7ea2-ccda-4a05-9903-c209247bd6f8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:17.925290 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bf5a7ea2-ccda-4a05-9903-c209247bd6f8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:17.925726 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bf5a7ea2-ccda-4a05-9903-c209247bd6f8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:18.011044 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-cf9115ec-c20e-49c5-9f6b-32363f3e8594 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Action: 'create', calling method: .version_select at 0x7f92f0e77ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-130590834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABQ4XFbNIe8e3MHf8/z8EPBJZhQO0D/xUTK558Nye3PG6mJrxmUtornzoEIQA079wsLQsEAs9yNmtpbKJS6sBzU3GGHLFu4fZd+11YBo0zh3g9kNmLwSa9Pnc6bmI7qsg=="}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:18.050257 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-cf9115ec-c20e-49c5-9f6b-32363f3e8594 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Getting quotas for project 98f97ac03be44e0bb8ab21d985d1dd27. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:28:18.061822 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-cf9115ec-c20e-49c5-9f6b-32363f3e8594 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Getting quotas for user 781d4a4643374bc6a78c3553d62f7672 and project 98f97ac03be44e0bb8ab21d985d1dd27. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:28:18.129969 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-cf9115ec-c20e-49c5-9f6b-32363f3e8594 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.522783 Jun 03 15:28:18.130756 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 122/229] 10.222.0.93 () {60 vars in 1158 bytes} [Fri Jun 3 15:28:17 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:18.135755 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-81b7037c-8e86-4c95-b304-bfe336b1faae req-9dca5609-c92a-465b-88d4-085bd1e5fd05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f284eb-df90-4337-8bdf-511156b6a756", "tag": "3013216d-76f3-469e-9c86-a0bc71687991"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:18.160605 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-81b7037c-8e86-4c95-b304-bfe336b1faae req-9dca5609-c92a-465b-88d4-085bd1e5fd05 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:18.162796 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-81b7037c-8e86-4c95-b304-bfe336b1faae req-9dca5609-c92a-465b-88d4-085bd1e5fd05 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:18.173217 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=98 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:18.199412 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-81b7037c-8e86-4c95-b304-bfe336b1faae req-9dca5609-c92a-465b-88d4-085bd1e5fd05 service nova] Creating event network-changed:3013216d-76f3-469e-9c86-a0bc71687991 for instance 67f284eb-df90-4337-8bdf-511156b6a756 on hv-cinder-83124 Jun 03 15:28:18.215534 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-81b7037c-8e86-4c95-b304-bfe336b1faae req-9dca5609-c92a-465b-88d4-085bd1e5fd05 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080089 Jun 03 15:28:18.216270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 123/230] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:18.271546 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-bf5a7ea2-ccda-4a05-9903-c209247bd6f8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:18.286512 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-bf5a7ea2-ccda-4a05-9903-c209247bd6f8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.392555 Jun 03 15:28:18.288528 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 108/231] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:17 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:18.906474 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9128c38b-005b-4e21-97e2-96583f296a97 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:18.908256 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9128c38b-005b-4e21-97e2-96583f296a97 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:18.920856 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9128c38b-005b-4e21-97e2-96583f296a97 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:18.921310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9128c38b-005b-4e21-97e2-96583f296a97 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:18.927268 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9128c38b-005b-4e21-97e2-96583f296a97 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:18.927723 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9128c38b-005b-4e21-97e2-96583f296a97 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:19.311056 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a2b3c044-4ecd-4b8b-bd76-ea69d44b7fa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:19.312592 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a2b3c044-4ecd-4b8b-bd76-ea69d44b7fa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:19.332467 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2b3c044-4ecd-4b8b-bd76-ea69d44b7fa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:19.334133 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2b3c044-4ecd-4b8b-bd76-ea69d44b7fa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:19.337149 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2b3c044-4ecd-4b8b-bd76-ea69d44b7fa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:19.338835 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2b3c044-4ecd-4b8b-bd76-ea69d44b7fa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:19.501193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9128c38b-005b-4e21-97e2-96583f296a97 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:19.515693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9128c38b-005b-4e21-97e2-96583f296a97 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.613619 Jun 03 15:28:19.529455 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 124/232] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:18 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:19.704445 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a2b3c044-4ecd-4b8b-bd76-ea69d44b7fa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:19.719139 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a2b3c044-4ecd-4b8b-bd76-ea69d44b7fa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.417046 Jun 03 15:28:19.721680 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 109/233] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:19 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:20.535405 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d2d6033b-4ecd-4519-9282-da6d215cc1a1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:20.537372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d2d6033b-4ecd-4519-9282-da6d215cc1a1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:20.547587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d2d6033b-4ecd-4519-9282-da6d215cc1a1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:20.548308 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d2d6033b-4ecd-4519-9282-da6d215cc1a1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:20.549278 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d2d6033b-4ecd-4519-9282-da6d215cc1a1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:20.549880 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d2d6033b-4ecd-4519-9282-da6d215cc1a1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:20.724597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d2d6033b-4ecd-4519-9282-da6d215cc1a1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:20.733504 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d2d6033b-4ecd-4519-9282-da6d215cc1a1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.202486 Jun 03 15:28:20.734299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 125/234] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:20 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:20.736241 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c58374f6-ff94-4069-8a4c-817081ad7807 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:20.736862 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c58374f6-ff94-4069-8a4c-817081ad7807 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:20.746662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c58374f6-ff94-4069-8a4c-817081ad7807 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:20.747117 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c58374f6-ff94-4069-8a4c-817081ad7807 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:20.747906 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c58374f6-ff94-4069-8a4c-817081ad7807 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:20.748353 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c58374f6-ff94-4069-8a4c-817081ad7807 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:20.928024 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c58374f6-ff94-4069-8a4c-817081ad7807 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:20.937121 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c58374f6-ff94-4069-8a4c-817081ad7807 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.204783 Jun 03 15:28:20.938602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 110/235] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:20 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:21.749846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-59fcb96d-5ecd-4043-b970-df7aa53475fb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:21.750805 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-59fcb96d-5ecd-4043-b970-df7aa53475fb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:21.758454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-59fcb96d-5ecd-4043-b970-df7aa53475fb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:21.759042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-59fcb96d-5ecd-4043-b970-df7aa53475fb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:21.759907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-59fcb96d-5ecd-4043-b970-df7aa53475fb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:21.760473 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-59fcb96d-5ecd-4043-b970-df7aa53475fb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:21.934611 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-59fcb96d-5ecd-4043-b970-df7aa53475fb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:21.944341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-59fcb96d-5ecd-4043-b970-df7aa53475fb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.198270 Jun 03 15:28:21.954668 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 126/236] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:21 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:21.960545 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-44f88a76-e443-4ece-a1bb-9c9ac2ad0812 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:21.961350 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-44f88a76-e443-4ece-a1bb-9c9ac2ad0812 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:21.968125 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44f88a76-e443-4ece-a1bb-9c9ac2ad0812 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:21.968580 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44f88a76-e443-4ece-a1bb-9c9ac2ad0812 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:21.969356 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44f88a76-e443-4ece-a1bb-9c9ac2ad0812 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:21.969795 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44f88a76-e443-4ece-a1bb-9c9ac2ad0812 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:22.143608 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-44f88a76-e443-4ece-a1bb-9c9ac2ad0812 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:22.153283 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-44f88a76-e443-4ece-a1bb-9c9ac2ad0812 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.197160 Jun 03 15:28:22.153863 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 111/237] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:21 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:22.961334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f8443611-4812-4b59-a453-0cc67fcfbe5a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:22.961961 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f8443611-4812-4b59-a453-0cc67fcfbe5a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:22.968002 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8443611-4812-4b59-a453-0cc67fcfbe5a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:22.968444 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8443611-4812-4b59-a453-0cc67fcfbe5a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:22.969190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8443611-4812-4b59-a453-0cc67fcfbe5a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:22.969617 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8443611-4812-4b59-a453-0cc67fcfbe5a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:23.101671 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f8443611-4812-4b59-a453-0cc67fcfbe5a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:23.109091 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f8443611-4812-4b59-a453-0cc67fcfbe5a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.151653 Jun 03 15:28:23.109695 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 127/238] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:22 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:23.169990 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6cab9867-eba2-4397-abbc-4fba915962a4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:23.170578 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6cab9867-eba2-4397-abbc-4fba915962a4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:23.176951 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6cab9867-eba2-4397-abbc-4fba915962a4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:23.177401 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6cab9867-eba2-4397-abbc-4fba915962a4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:23.178167 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6cab9867-eba2-4397-abbc-4fba915962a4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:23.178649 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6cab9867-eba2-4397-abbc-4fba915962a4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:23.316629 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6cab9867-eba2-4397-abbc-4fba915962a4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:23.324185 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6cab9867-eba2-4397-abbc-4fba915962a4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.158065 Jun 03 15:28:23.324748 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 112/239] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:23 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:24.125055 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a9babb17-695f-4bd2-b788-8fb15cb26a87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:24.125664 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a9babb17-695f-4bd2-b788-8fb15cb26a87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:24.138680 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a9babb17-695f-4bd2-b788-8fb15cb26a87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:24.139209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a9babb17-695f-4bd2-b788-8fb15cb26a87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:24.140144 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a9babb17-695f-4bd2-b788-8fb15cb26a87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:24.140584 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a9babb17-695f-4bd2-b788-8fb15cb26a87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:24.270296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a9babb17-695f-4bd2-b788-8fb15cb26a87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:24.278327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a9babb17-695f-4bd2-b788-8fb15cb26a87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.156937 Jun 03 15:28:24.279133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 128/240] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:24 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:24.343232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0d3e8658-c546-476e-9220-8f2bc204dfcf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:24.343914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0d3e8658-c546-476e-9220-8f2bc204dfcf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:24.351107 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0d3e8658-c546-476e-9220-8f2bc204dfcf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:24.351651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0d3e8658-c546-476e-9220-8f2bc204dfcf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:24.352782 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0d3e8658-c546-476e-9220-8f2bc204dfcf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:24.353293 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0d3e8658-c546-476e-9220-8f2bc204dfcf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:24.487352 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0d3e8658-c546-476e-9220-8f2bc204dfcf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:24.495562 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0d3e8658-c546-476e-9220-8f2bc204dfcf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.158103 Jun 03 15:28:24.496153 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 113/241] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:24 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:25.299341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b0beae67-33ec-472f-bfc6-7ee064466808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:25.299765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b0beae67-33ec-472f-bfc6-7ee064466808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:25.303272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:25.309175 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b0beae67-33ec-472f-bfc6-7ee064466808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:25.309653 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b0beae67-33ec-472f-bfc6-7ee064466808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:25.311174 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b0beae67-33ec-472f-bfc6-7ee064466808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:25.311569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b0beae67-33ec-472f-bfc6-7ee064466808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:25.449816 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b0beae67-33ec-472f-bfc6-7ee064466808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:25.457505 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b0beae67-33ec-472f-bfc6-7ee064466808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.165002 Jun 03 15:28:25.458128 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 129/242] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:25 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:25.512477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9002b200-d433-4797-8beb-b28b69d608bd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:25.513163 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9002b200-d433-4797-8beb-b28b69d608bd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:25.519670 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9002b200-d433-4797-8beb-b28b69d608bd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:25.520115 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9002b200-d433-4797-8beb-b28b69d608bd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:25.521128 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9002b200-d433-4797-8beb-b28b69d608bd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:25.521560 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9002b200-d433-4797-8beb-b28b69d608bd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:25.677489 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9002b200-d433-4797-8beb-b28b69d608bd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:25.685683 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9002b200-d433-4797-8beb-b28b69d608bd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.176974 Jun 03 15:28:25.686248 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 114/243] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:25 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:26.479338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-58afc00b-170b-45da-97f6-7834e9423328 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:26.480220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-58afc00b-170b-45da-97f6-7834e9423328 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:26.487878 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-58afc00b-170b-45da-97f6-7834e9423328 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:26.495989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-58afc00b-170b-45da-97f6-7834e9423328 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:26.495989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-58afc00b-170b-45da-97f6-7834e9423328 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:26.495989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-58afc00b-170b-45da-97f6-7834e9423328 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:26.622632 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-58afc00b-170b-45da-97f6-7834e9423328 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:26.630869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-58afc00b-170b-45da-97f6-7834e9423328 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.159508 Jun 03 15:28:26.631438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 130/244] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:26 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:26.704500 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8c6745cd-174e-4004-8102-877097e016b1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:26.705090 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8c6745cd-174e-4004-8102-877097e016b1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:26.712306 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8c6745cd-174e-4004-8102-877097e016b1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:26.712758 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8c6745cd-174e-4004-8102-877097e016b1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:26.713520 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8c6745cd-174e-4004-8102-877097e016b1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:26.713955 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8c6745cd-174e-4004-8102-877097e016b1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:26.729709 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=100 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:26.860350 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-8c6745cd-174e-4004-8102-877097e016b1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:26.868503 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8c6745cd-174e-4004-8102-877097e016b1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.167886 Jun 03 15:28:26.869064 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 115/245] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:26 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:27.648497 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7d7b8595-b151-4832-bf64-e15347a051eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:27.649224 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7d7b8595-b151-4832-bf64-e15347a051eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:27.655377 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7d7b8595-b151-4832-bf64-e15347a051eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:27.655815 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7d7b8595-b151-4832-bf64-e15347a051eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:27.656570 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7d7b8595-b151-4832-bf64-e15347a051eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:27.656997 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7d7b8595-b151-4832-bf64-e15347a051eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:27.786256 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7d7b8595-b151-4832-bf64-e15347a051eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:27.793649 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7d7b8595-b151-4832-bf64-e15347a051eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.149828 Jun 03 15:28:27.794212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 131/246] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:27 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:27.886602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5e5c50af-fad7-4148-9087-94f854dcc1c3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:27.887245 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5e5c50af-fad7-4148-9087-94f854dcc1c3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:27.894213 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5e5c50af-fad7-4148-9087-94f854dcc1c3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:27.894708 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5e5c50af-fad7-4148-9087-94f854dcc1c3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:27.896283 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5e5c50af-fad7-4148-9087-94f854dcc1c3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:27.896715 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5e5c50af-fad7-4148-9087-94f854dcc1c3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:28.041187 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5e5c50af-fad7-4148-9087-94f854dcc1c3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:28.049994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5e5c50af-fad7-4148-9087-94f854dcc1c3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.168138 Jun 03 15:28:28.050589 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 116/247] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:27 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:28.725410 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-86cd5063-af3f-4036-acfe-b615503aee0c req-22e7d775-d44a-4f70-addf-ce3a833b5549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f284eb-df90-4337-8bdf-511156b6a756", "name": "network-vif-plugged", "status": "completed", "tag": "3013216d-76f3-469e-9c86-a0bc71687991"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:28.728888 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=4 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:28.735118 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-86cd5063-af3f-4036-acfe-b615503aee0c req-22e7d775-d44a-4f70-addf-ce3a833b5549 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:28.735571 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-86cd5063-af3f-4036-acfe-b615503aee0c req-22e7d775-d44a-4f70-addf-ce3a833b5549 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:28.747659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-86cd5063-af3f-4036-acfe-b615503aee0c req-22e7d775-d44a-4f70-addf-ce3a833b5549 service nova] Creating event network-vif-plugged:3013216d-76f3-469e-9c86-a0bc71687991 for instance 67f284eb-df90-4337-8bdf-511156b6a756 on hv-cinder-83124 Jun 03 15:28:28.752773 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-86cd5063-af3f-4036-acfe-b615503aee0c req-22e7d775-d44a-4f70-addf-ce3a833b5549 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031511 Jun 03 15:28:28.753355 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 132/248] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:28.810324 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c636a1b0-aab7-46d6-affc-8ef9c5eb0323 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:28.811036 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c636a1b0-aab7-46d6-affc-8ef9c5eb0323 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:28.817375 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c636a1b0-aab7-46d6-affc-8ef9c5eb0323 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:28.818174 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c636a1b0-aab7-46d6-affc-8ef9c5eb0323 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:28.819191 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c636a1b0-aab7-46d6-affc-8ef9c5eb0323 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:28.819821 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c636a1b0-aab7-46d6-affc-8ef9c5eb0323 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:28.976320 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c636a1b0-aab7-46d6-affc-8ef9c5eb0323 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:28.984328 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c636a1b0-aab7-46d6-affc-8ef9c5eb0323 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.177786 Jun 03 15:28:28.985320 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 117/249] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:28 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:29.067565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d0b36c6e-59b7-444f-93eb-f8e903558fbb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:29.068260 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d0b36c6e-59b7-444f-93eb-f8e903558fbb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:29.074410 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d0b36c6e-59b7-444f-93eb-f8e903558fbb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:29.074889 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d0b36c6e-59b7-444f-93eb-f8e903558fbb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:29.075651 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d0b36c6e-59b7-444f-93eb-f8e903558fbb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:29.076086 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d0b36c6e-59b7-444f-93eb-f8e903558fbb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:29.223433 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d0b36c6e-59b7-444f-93eb-f8e903558fbb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:29.231496 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d0b36c6e-59b7-444f-93eb-f8e903558fbb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.168241 Jun 03 15:28:29.232067 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 133/250] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:29 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:30.002725 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a361e7cc-a13f-4935-b50c-ae1027a0deca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:30.003341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a361e7cc-a13f-4935-b50c-ae1027a0deca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:30.010387 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a361e7cc-a13f-4935-b50c-ae1027a0deca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:30.010862 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a361e7cc-a13f-4935-b50c-ae1027a0deca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:30.011617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a361e7cc-a13f-4935-b50c-ae1027a0deca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:30.012048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a361e7cc-a13f-4935-b50c-ae1027a0deca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:30.143072 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a361e7cc-a13f-4935-b50c-ae1027a0deca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:30.150879 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a361e7cc-a13f-4935-b50c-ae1027a0deca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.151931 Jun 03 15:28:30.151427 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 118/251] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:29 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:30.249162 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-19bdfdb7-d588-4783-a6dd-99727497e5dd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:30.249753 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-19bdfdb7-d588-4783-a6dd-99727497e5dd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:30.255793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-19bdfdb7-d588-4783-a6dd-99727497e5dd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:30.256234 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-19bdfdb7-d588-4783-a6dd-99727497e5dd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:30.256997 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-19bdfdb7-d588-4783-a6dd-99727497e5dd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:30.257496 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-19bdfdb7-d588-4783-a6dd-99727497e5dd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:30.408146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-19bdfdb7-d588-4783-a6dd-99727497e5dd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:30.421929 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-19bdfdb7-d588-4783-a6dd-99727497e5dd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.176724 Jun 03 15:28:30.423048 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 134/252] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:30 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:31.167977 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5bff89ad-c44b-4949-83c9-bde7bf3b26a2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:31.168642 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5bff89ad-c44b-4949-83c9-bde7bf3b26a2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:31.175083 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5bff89ad-c44b-4949-83c9-bde7bf3b26a2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:31.175532 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5bff89ad-c44b-4949-83c9-bde7bf3b26a2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:31.176291 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5bff89ad-c44b-4949-83c9-bde7bf3b26a2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:31.176725 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5bff89ad-c44b-4949-83c9-bde7bf3b26a2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:31.311944 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5bff89ad-c44b-4949-83c9-bde7bf3b26a2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:31.321118 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5bff89ad-c44b-4949-83c9-bde7bf3b26a2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1357 microversion: 2.1 time: 0.156876 Jun 03 15:28:31.321783 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 119/253] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:31 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:31.439547 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-658b29c6-6154-4047-a52c-23dbd161418b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:31.440763 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-658b29c6-6154-4047-a52c-23dbd161418b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:31.447930 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-658b29c6-6154-4047-a52c-23dbd161418b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:31.448699 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-658b29c6-6154-4047-a52c-23dbd161418b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:31.449631 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-658b29c6-6154-4047-a52c-23dbd161418b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:31.450092 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-658b29c6-6154-4047-a52c-23dbd161418b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:31.614006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-658b29c6-6154-4047-a52c-23dbd161418b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:31.621483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-658b29c6-6154-4047-a52c-23dbd161418b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.186102 Jun 03 15:28:31.622047 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 135/254] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:31 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:32.338279 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-76f96dc8-1df2-4970-a3c3-abbe75efc220 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:32.338924 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-76f96dc8-1df2-4970-a3c3-abbe75efc220 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:32.341289 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:32.346817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76f96dc8-1df2-4970-a3c3-abbe75efc220 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:32.347267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76f96dc8-1df2-4970-a3c3-abbe75efc220 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:32.348718 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76f96dc8-1df2-4970-a3c3-abbe75efc220 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:32.349153 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76f96dc8-1df2-4970-a3c3-abbe75efc220 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:32.480371 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-76f96dc8-1df2-4970-a3c3-abbe75efc220 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:32.488068 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-76f96dc8-1df2-4970-a3c3-abbe75efc220 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1546 microversion: 2.1 time: 0.153671 Jun 03 15:28:32.488697 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 120/255] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:32 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:32.505591 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6917eb7f-06af-408a-a7a8-aa8430d3ee85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:32.506198 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6917eb7f-06af-408a-a7a8-aa8430d3ee85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:32.512993 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6917eb7f-06af-408a-a7a8-aa8430d3ee85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:32.513467 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6917eb7f-06af-408a-a7a8-aa8430d3ee85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:32.514220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6917eb7f-06af-408a-a7a8-aa8430d3ee85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:32.514668 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6917eb7f-06af-408a-a7a8-aa8430d3ee85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:32.639255 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ba5bd4de-3dcd-4fe8-a5ba-fa2449c53347 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:32.639870 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ba5bd4de-3dcd-4fe8-a5ba-fa2449c53347 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:32.647093 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ba5bd4de-3dcd-4fe8-a5ba-fa2449c53347 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:32.647542 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ba5bd4de-3dcd-4fe8-a5ba-fa2449c53347 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:32.648532 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ba5bd4de-3dcd-4fe8-a5ba-fa2449c53347 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:32.648977 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ba5bd4de-3dcd-4fe8-a5ba-fa2449c53347 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:32.650392 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6917eb7f-06af-408a-a7a8-aa8430d3ee85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:32.658300 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6917eb7f-06af-408a-a7a8-aa8430d3ee85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1546 microversion: 2.1 time: 0.157145 Jun 03 15:28:32.658913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 136/256] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:32 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:32.673981 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c01cff56-6d75-4357-bdf2-391502ace377 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:32.678026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c01cff56-6d75-4357-bdf2-391502ace377 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:32.678826 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c01cff56-6d75-4357-bdf2-391502ace377 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Searching by: {'deleted': False, 'project_id': '00d2022cc4be4779af1edf1520c439ae'} {{(pid=117806) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 03 15:28:32.685859 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c01cff56-6d75-4357-bdf2-391502ace377 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:32.686305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c01cff56-6d75-4357-bdf2-391502ace377 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:32.687427 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c01cff56-6d75-4357-bdf2-391502ace377 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:32.687871 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c01cff56-6d75-4357-bdf2-391502ace377 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:32.777960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.multi_cell_list [None req-c01cff56-6d75-4357-bdf2-391502ace377 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117806) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 03 15:28:32.783788 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ba5bd4de-3dcd-4fe8-a5ba-fa2449c53347 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:32.791617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ba5bd4de-3dcd-4fe8-a5ba-fa2449c53347 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.156383 Jun 03 15:28:32.792187 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 121/257] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:32 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:32.873474 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c01cff56-6d75-4357-bdf2-391502ace377 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203182 Jun 03 15:28:32.874759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 137/258] 10.222.0.93 () {58 vars in 1124 bytes} [Fri Jun 3 15:28:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:28:32.885000 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7c7391eb-397e-4fb8-a642-c4c088e64b0e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:32.885608 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7c7391eb-397e-4fb8-a642-c4c088e64b0e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:32.892059 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7c7391eb-397e-4fb8-a642-c4c088e64b0e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:32.892585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7c7391eb-397e-4fb8-a642-c4c088e64b0e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:32.893269 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7c7391eb-397e-4fb8-a642-c4c088e64b0e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:32.893702 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7c7391eb-397e-4fb8-a642-c4c088e64b0e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:33.024496 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7c7391eb-397e-4fb8-a642-c4c088e64b0e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:33.032110 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7c7391eb-397e-4fb8-a642-c4c088e64b0e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1546 microversion: 2.1 time: 0.151013 Jun 03 15:28:33.032678 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 122/259] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:32 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:33.808446 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b77efc7e-a957-4b5a-ba5f-16b3cfde4138 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:33.809055 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b77efc7e-a957-4b5a-ba5f-16b3cfde4138 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:33.815184 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b77efc7e-a957-4b5a-ba5f-16b3cfde4138 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:33.815622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b77efc7e-a957-4b5a-ba5f-16b3cfde4138 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:33.816388 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b77efc7e-a957-4b5a-ba5f-16b3cfde4138 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:33.816830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b77efc7e-a957-4b5a-ba5f-16b3cfde4138 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:33.940687 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b77efc7e-a957-4b5a-ba5f-16b3cfde4138 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:33.949507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b77efc7e-a957-4b5a-ba5f-16b3cfde4138 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.144926 Jun 03 15:28:33.950077 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 138/260] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:33 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:34.968626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-91cfef2a-26f7-4461-bece-9823ec9a1e9d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:34.969154 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-91cfef2a-26f7-4461-bece-9823ec9a1e9d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:34.976529 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91cfef2a-26f7-4461-bece-9823ec9a1e9d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:34.976979 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91cfef2a-26f7-4461-bece-9823ec9a1e9d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:34.977763 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91cfef2a-26f7-4461-bece-9823ec9a1e9d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:34.978197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91cfef2a-26f7-4461-bece-9823ec9a1e9d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:35.111096 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-91cfef2a-26f7-4461-bece-9823ec9a1e9d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:35.119163 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-91cfef2a-26f7-4461-bece-9823ec9a1e9d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.154526 Jun 03 15:28:35.119734 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 123/261] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:34 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:36.138286 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d63d1c15-e80b-48ac-a9e2-c3a6bca8efa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:36.139059 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d63d1c15-e80b-48ac-a9e2-c3a6bca8efa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:36.146806 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d63d1c15-e80b-48ac-a9e2-c3a6bca8efa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:36.148799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d63d1c15-e80b-48ac-a9e2-c3a6bca8efa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:36.148799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d63d1c15-e80b-48ac-a9e2-c3a6bca8efa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:36.149164 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d63d1c15-e80b-48ac-a9e2-c3a6bca8efa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:36.287002 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d63d1c15-e80b-48ac-a9e2-c3a6bca8efa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:36.294613 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d63d1c15-e80b-48ac-a9e2-c3a6bca8efa9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1522 microversion: 2.1 time: 0.161499 Jun 03 15:28:36.295177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 139/262] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:36 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:36.733709 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3ef0545e-8a36-4515-9549-606ae504c8c2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "966626ff-cc10-42b5-ac79-06fffa57d175"}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:36.735554 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3ef0545e-8a36-4515-9549-606ae504c8c2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:36.743197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3ef0545e-8a36-4515-9549-606ae504c8c2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:36.743852 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3ef0545e-8a36-4515-9549-606ae504c8c2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:36.744929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3ef0545e-8a36-4515-9549-606ae504c8c2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:36.745703 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3ef0545e-8a36-4515-9549-606ae504c8c2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:37.312195 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6322a83b-b9db-4b0a-96e5-57bf8f9ee850 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:37.312860 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6322a83b-b9db-4b0a-96e5-57bf8f9ee850 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:37.319876 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6322a83b-b9db-4b0a-96e5-57bf8f9ee850 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:37.320325 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6322a83b-b9db-4b0a-96e5-57bf8f9ee850 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:37.321101 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6322a83b-b9db-4b0a-96e5-57bf8f9ee850 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:37.321545 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6322a83b-b9db-4b0a-96e5-57bf8f9ee850 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:37.457099 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6322a83b-b9db-4b0a-96e5-57bf8f9ee850 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:37.459568 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=100 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:37.466795 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6322a83b-b9db-4b0a-96e5-57bf8f9ee850 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1502 microversion: 2.1 time: 0.158447 Jun 03 15:28:37.467368 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 140/263] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:37 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:37.482984 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2b867d53-97f7-470e-9f87-817e993dc169 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:37.483655 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2b867d53-97f7-470e-9f87-817e993dc169 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:37.490980 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2b867d53-97f7-470e-9f87-817e993dc169 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:37.491464 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2b867d53-97f7-470e-9f87-817e993dc169 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:37.492242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2b867d53-97f7-470e-9f87-817e993dc169 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:37.492682 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2b867d53-97f7-470e-9f87-817e993dc169 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:37.591173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3ef0545e-8a36-4515-9549-606ae504c8c2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "POST /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862885 Jun 03 15:28:37.591691 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 124/264] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:28:36 2022] POST /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments => generated 194 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:37.668012 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2b867d53-97f7-470e-9f87-817e993dc169 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:37.676278 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2b867d53-97f7-470e-9f87-817e993dc169 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1516 microversion: 2.1 time: 0.196745 Jun 03 15:28:37.676853 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 141/265] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:37 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:39.047476 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d7accb29-35eb-47c7-9d3d-99464a2a5ba9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:39.048517 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d7accb29-35eb-47c7-9d3d-99464a2a5ba9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:39.056617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d7accb29-35eb-47c7-9d3d-99464a2a5ba9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:39.057085 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d7accb29-35eb-47c7-9d3d-99464a2a5ba9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:39.057862 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d7accb29-35eb-47c7-9d3d-99464a2a5ba9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:39.058410 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d7accb29-35eb-47c7-9d3d-99464a2a5ba9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:39.082882 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-d7accb29-35eb-47c7-9d3d-99464a2a5ba9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lazy-loading 'flavor' on Instance uuid cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:28:39.195295 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d7accb29-35eb-47c7-9d3d-99464a2a5ba9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3/action" status: 200 len: 32 microversion: 2.1 time: 0.152398 Jun 03 15:28:39.195895 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 125/266] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:28:39 2022] POST /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 15:28:39.205179 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e0189fba-0885-4c9d-bda8-09aa8ee0c48a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:39.205795 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e0189fba-0885-4c9d-bda8-09aa8ee0c48a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:39.212102 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0189fba-0885-4c9d-bda8-09aa8ee0c48a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:39.212527 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0189fba-0885-4c9d-bda8-09aa8ee0c48a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:39.213299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0189fba-0885-4c9d-bda8-09aa8ee0c48a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:39.213736 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0189fba-0885-4c9d-bda8-09aa8ee0c48a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:39.459494 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e0189fba-0885-4c9d-bda8-09aa8ee0c48a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:39.476705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e0189fba-0885-4c9d-bda8-09aa8ee0c48a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.275573 Jun 03 15:28:39.485407 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 142/267] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:39 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:40.498583 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-32267f56-0a1f-4905-b943-42baa47b76eb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:40.499285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-32267f56-0a1f-4905-b943-42baa47b76eb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:40.506770 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32267f56-0a1f-4905-b943-42baa47b76eb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:40.507273 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32267f56-0a1f-4905-b943-42baa47b76eb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:40.508052 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32267f56-0a1f-4905-b943-42baa47b76eb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:40.508488 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32267f56-0a1f-4905-b943-42baa47b76eb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:40.656718 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-32267f56-0a1f-4905-b943-42baa47b76eb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:40.664010 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-32267f56-0a1f-4905-b943-42baa47b76eb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.169809 Jun 03 15:28:40.665183 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 126/268] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:40 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:41.683018 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7783c58a-f76b-4723-bbae-a0ebea9b3bb6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:41.683943 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7783c58a-f76b-4723-bbae-a0ebea9b3bb6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:41.693477 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7783c58a-f76b-4723-bbae-a0ebea9b3bb6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:41.693920 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7783c58a-f76b-4723-bbae-a0ebea9b3bb6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:41.694963 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7783c58a-f76b-4723-bbae-a0ebea9b3bb6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:41.695437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7783c58a-f76b-4723-bbae-a0ebea9b3bb6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:41.883978 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7783c58a-f76b-4723-bbae-a0ebea9b3bb6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:41.897027 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7783c58a-f76b-4723-bbae-a0ebea9b3bb6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.218973 Jun 03 15:28:41.897705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 143/269] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:41 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:42.913530 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-30936952-9557-4dcf-a3ce-f8776bdbc333 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:42.914451 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-30936952-9557-4dcf-a3ce-f8776bdbc333 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:42.921219 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-30936952-9557-4dcf-a3ce-f8776bdbc333 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:42.921672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-30936952-9557-4dcf-a3ce-f8776bdbc333 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:42.922568 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-30936952-9557-4dcf-a3ce-f8776bdbc333 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:42.923003 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-30936952-9557-4dcf-a3ce-f8776bdbc333 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:43.087115 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-30936952-9557-4dcf-a3ce-f8776bdbc333 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:43.096230 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-30936952-9557-4dcf-a3ce-f8776bdbc333 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.187049 Jun 03 15:28:43.096896 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 127/270] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:42 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:44.113236 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-46e66973-78c9-45bb-8a2c-c31c91678c5b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:44.113961 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-46e66973-78c9-45bb-8a2c-c31c91678c5b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:44.115950 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:44.121766 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-46e66973-78c9-45bb-8a2c-c31c91678c5b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:44.122216 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-46e66973-78c9-45bb-8a2c-c31c91678c5b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:44.123016 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-46e66973-78c9-45bb-8a2c-c31c91678c5b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:44.123448 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-46e66973-78c9-45bb-8a2c-c31c91678c5b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:44.259523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-46e66973-78c9-45bb-8a2c-c31c91678c5b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:44.267308 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-46e66973-78c9-45bb-8a2c-c31c91678c5b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.157908 Jun 03 15:28:44.267885 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 144/271] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:44 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:44.671371 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e5f821c3-94e9-4fc9-9e94-6f48dee501a7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:44.672045 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e5f821c3-94e9-4fc9-9e94-6f48dee501a7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:44.679099 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5f821c3-94e9-4fc9-9e94-6f48dee501a7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:44.679567 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5f821c3-94e9-4fc9-9e94-6f48dee501a7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:44.680334 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5f821c3-94e9-4fc9-9e94-6f48dee501a7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:44.680826 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5f821c3-94e9-4fc9-9e94-6f48dee501a7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:44.708111 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e5f821c3-94e9-4fc9-9e94-6f48dee501a7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/ips" status: 200 len: 145 microversion: 2.1 time: 0.040650 Jun 03 15:28:44.708762 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 128/272] 10.222.0.93 () {58 vars in 1247 bytes} [Fri Jun 3 15:28:44 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:45.287615 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-81b42f6a-c725-4eb7-90a4-17d3af1d0db2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:45.288427 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-81b42f6a-c725-4eb7-90a4-17d3af1d0db2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:45.297657 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-81b42f6a-c725-4eb7-90a4-17d3af1d0db2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:45.298300 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-81b42f6a-c725-4eb7-90a4-17d3af1d0db2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:45.299099 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-81b42f6a-c725-4eb7-90a4-17d3af1d0db2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:45.299531 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-81b42f6a-c725-4eb7-90a4-17d3af1d0db2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:45.373253 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-891c3817-d712-4437-998c-54ef7ababbe9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:45.374562 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-891c3817-d712-4437-998c-54ef7ababbe9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:45.381111 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-891c3817-d712-4437-998c-54ef7ababbe9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:45.381645 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-891c3817-d712-4437-998c-54ef7ababbe9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:45.382554 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-891c3817-d712-4437-998c-54ef7ababbe9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:45.383280 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-891c3817-d712-4437-998c-54ef7ababbe9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:45.387686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:45.412763 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-891c3817-d712-4437-998c-54ef7ababbe9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/ips" status: 200 len: 149 microversion: 2.1 time: 0.043457 Jun 03 15:28:45.413339 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 129/273] 10.222.0.93 () {58 vars in 1247 bytes} [Fri Jun 3 15:28:45 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:45.441552 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-81b42f6a-c725-4eb7-90a4-17d3af1d0db2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:45.450191 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-81b42f6a-c725-4eb7-90a4-17d3af1d0db2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.168705 Jun 03 15:28:45.450996 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 145/274] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:45 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:45.843513 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-fe6ee0b5-99e3-4d2f-b14a-c7b792672add tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:45.843998 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-fe6ee0b5-99e3-4d2f-b14a-c7b792672add tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:45.852889 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe6ee0b5-99e3-4d2f-b14a-c7b792672add tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:45.853875 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe6ee0b5-99e3-4d2f-b14a-c7b792672add tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:45.854114 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe6ee0b5-99e3-4d2f-b14a-c7b792672add tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:45.854567 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe6ee0b5-99e3-4d2f-b14a-c7b792672add tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:45.879334 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-fe6ee0b5-99e3-4d2f-b14a-c7b792672add tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/ips" status: 200 len: 152 microversion: 2.20 time: 0.039622 Jun 03 15:28:45.880129 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 130/275] 10.222.0.93 () {60 vars in 1288 bytes} [Fri Jun 3 15:28:45 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:28:46.318325 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2e8fef8b-3089-419f-8b06-ea4d55c00e74 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:46.318971 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2e8fef8b-3089-419f-8b06-ea4d55c00e74 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:46.325236 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2e8fef8b-3089-419f-8b06-ea4d55c00e74 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:46.325772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2e8fef8b-3089-419f-8b06-ea4d55c00e74 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:46.327147 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2e8fef8b-3089-419f-8b06-ea4d55c00e74 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:46.327653 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2e8fef8b-3089-419f-8b06-ea4d55c00e74 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:46.465195 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2e8fef8b-3089-419f-8b06-ea4d55c00e74 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:46.467115 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b49145fb-fa9f-4a98-9151-82ce8e1c617a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:46.467925 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b49145fb-fa9f-4a98-9151-82ce8e1c617a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:46.473509 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2e8fef8b-3089-419f-8b06-ea4d55c00e74 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1592 microversion: 2.1 time: 0.160511 Jun 03 15:28:46.473814 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b49145fb-fa9f-4a98-9151-82ce8e1c617a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:46.474234 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 146/276] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:46 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1592 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:46.474342 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b49145fb-fa9f-4a98-9151-82ce8e1c617a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:46.475039 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b49145fb-fa9f-4a98-9151-82ce8e1c617a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:46.475470 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b49145fb-fa9f-4a98-9151-82ce8e1c617a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:46.613676 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b49145fb-fa9f-4a98-9151-82ce8e1c617a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:46.621168 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b49145fb-fa9f-4a98-9151-82ce8e1c617a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.157865 Jun 03 15:28:46.621737 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 131/277] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:46 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:46.836832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8634375b-7e8c-4b06-9b1f-fb5d2926a1c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "382bff78-a0d7-4f57-a223-b258872078c2"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:46.838155 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8634375b-7e8c-4b06-9b1f-fb5d2926a1c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:46.844213 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8634375b-7e8c-4b06-9b1f-fb5d2926a1c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:46.844749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8634375b-7e8c-4b06-9b1f-fb5d2926a1c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:46.845587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8634375b-7e8c-4b06-9b1f-fb5d2926a1c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:46.846085 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8634375b-7e8c-4b06-9b1f-fb5d2926a1c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:47.121731 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2028148929", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-130590834", "security_groups": [{"name": "tempest-secgroup-smoke-1645567840"}], "networks": [{"uuid": "63fabd49-da18-4288-852a-c9b600b6fd0f"}], "block_device_mapping_v2": [{"uuid": "fb395b79-08bd-4e03-ab7c-0cd9d00194d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:47.164258 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8634375b-7e8c-4b06-9b1f-fb5d2926a1c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331313 Jun 03 15:28:47.165671 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 147/278] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:28:46 2022] POST /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:47.399338 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] validate_networks() for [('63fabd49-da18-4288-852a-c9b600b6fd0f', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:28:47.639919 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-dc87bc4e-d8f8-42fb-a192-07d8fc1ce866 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:47.640616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-dc87bc4e-d8f8-42fb-a192-07d8fc1ce866 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:47.647895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc87bc4e-d8f8-42fb-a192-07d8fc1ce866 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:47.649036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc87bc4e-d8f8-42fb-a192-07d8fc1ce866 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:47.650169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc87bc4e-d8f8-42fb-a192-07d8fc1ce866 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:47.650845 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc87bc4e-d8f8-42fb-a192-07d8fc1ce866 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:47.792201 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-dc87bc4e-d8f8-42fb-a192-07d8fc1ce866 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:47.800629 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-dc87bc4e-d8f8-42fb-a192-07d8fc1ce866 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.164853 Jun 03 15:28:47.801199 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 148/279] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:47 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:48.132054 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:28:48.133232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:28:48.134080 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:28:48.135160 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:28:48.136030 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:28:48.152222 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:48.152969 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:48.154015 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:48.154703 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:48.176532 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Getting quotas for project 98f97ac03be44e0bb8ab21d985d1dd27. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:28:48.183253 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Getting quotas for user 781d4a4643374bc6a78c3553d62f7672 and project 98f97ac03be44e0bb8ab21d985d1dd27. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:28:48.308502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:28:48.310798 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb395b79-08bd-4e03-ab7c-0cd9d00194d5',volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:28:48.457249 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a6330286-62dd-4b95-82ac-f517be92a671 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.339788 Jun 03 15:28:48.458121 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 132/280] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:28:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 15:28:48.468324 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0b099563-ed7d-424f-9b3d-89c4e64f77d6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:48.468932 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0b099563-ed7d-424f-9b3d-89c4e64f77d6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:48.524393 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0b099563-ed7d-424f-9b3d-89c4e64f77d6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:48.532231 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0b099563-ed7d-424f-9b3d-89c4e64f77d6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1088 microversion: 2.1 time: 0.067682 Jun 03 15:28:48.532811 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 149/281] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:48 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:48.702454 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-836041b3-ad72-4871-ba50-c6e5412fd198 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:48.702988 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-836041b3-ad72-4871-ba50-c6e5412fd198 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:48.718167 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-836041b3-ad72-4871-ba50-c6e5412fd198 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:48.718842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-836041b3-ad72-4871-ba50-c6e5412fd198 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:48.722848 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-836041b3-ad72-4871-ba50-c6e5412fd198 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:48.723300 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-836041b3-ad72-4871-ba50-c6e5412fd198 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:48.786296 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-836041b3-ad72-4871-ba50-c6e5412fd198 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lazy-loading 'flavor' on Instance uuid e123dc0c-78c6-44ce-b847-927843a3751c {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:28:48.817930 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-09d60d99-4d4f-49ff-9ffc-417b70793e39 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:48.819431 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-09d60d99-4d4f-49ff-9ffc-417b70793e39 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:48.835548 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-09d60d99-4d4f-49ff-9ffc-417b70793e39 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:48.841670 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-09d60d99-4d4f-49ff-9ffc-417b70793e39 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:48.845933 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-09d60d99-4d4f-49ff-9ffc-417b70793e39 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:48.849389 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-09d60d99-4d4f-49ff-9ffc-417b70793e39 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:49.451374 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-09d60d99-4d4f-49ff-9ffc-417b70793e39 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:49.460167 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-09d60d99-4d4f-49ff-9ffc-417b70793e39 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.646541 Jun 03 15:28:49.463336 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 150/282] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:48 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:49.469243 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-3d12a559-1bec-4897-b6a6-8f10c5d237e5 req-ee947c42-1196-4384-bc8f-6c6aa11a99ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f284eb-df90-4337-8bdf-511156b6a756", "tag": "3013216d-76f3-469e-9c86-a0bc71687991"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:49.486476 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-3d12a559-1bec-4897-b6a6-8f10c5d237e5 req-ee947c42-1196-4384-bc8f-6c6aa11a99ec service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:49.486954 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-3d12a559-1bec-4897-b6a6-8f10c5d237e5 req-ee947c42-1196-4384-bc8f-6c6aa11a99ec service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:49.516245 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-3d12a559-1bec-4897-b6a6-8f10c5d237e5 req-ee947c42-1196-4384-bc8f-6c6aa11a99ec service nova] Creating event network-changed:3013216d-76f3-469e-9c86-a0bc71687991 for instance 67f284eb-df90-4337-8bdf-511156b6a756 on hv-cinder-83124 Jun 03 15:28:49.526402 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-836041b3-ad72-4871-ba50-c6e5412fd198 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "POST /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/action" status: 202 len: 0 microversion: 2.20 time: 0.826361 Jun 03 15:28:49.527191 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-3d12a559-1bec-4897-b6a6-8f10c5d237e5 req-ee947c42-1196-4384-bc8f-6c6aa11a99ec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061946 Jun 03 15:28:49.528020 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 133/283] 10.222.0.93 () {62 vars in 1318 bytes} [Fri Jun 3 15:28:48 2022] POST /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 03 15:28:49.531919 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 151/284] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:49.538082 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d68574f7-5724-4aca-bf3b-528a905cf117 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:49.538298 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f9bdb9b8-438a-4324-bd90-639cd77ad54b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baf71ae5-f0f6-45bb-bb53-48b42385e465"}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:49.539177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d68574f7-5724-4aca-bf3b-528a905cf117 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:49.539810 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f9bdb9b8-438a-4324-bd90-639cd77ad54b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:49.552642 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f9bdb9b8-438a-4324-bd90-639cd77ad54b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:49.553537 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f9bdb9b8-438a-4324-bd90-639cd77ad54b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:49.554868 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f9bdb9b8-438a-4324-bd90-639cd77ad54b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:49.555537 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f9bdb9b8-438a-4324-bd90-639cd77ad54b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:49.556973 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d68574f7-5724-4aca-bf3b-528a905cf117 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:49.557586 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d68574f7-5724-4aca-bf3b-528a905cf117 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:49.558648 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d68574f7-5724-4aca-bf3b-528a905cf117 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:49.559294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d68574f7-5724-4aca-bf3b-528a905cf117 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:49.764768 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d68574f7-5724-4aca-bf3b-528a905cf117 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:49.775568 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d68574f7-5724-4aca-bf3b-528a905cf117 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:49.778170 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d68574f7-5724-4aca-bf3b-528a905cf117 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:49.781174 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d68574f7-5724-4aca-bf3b-528a905cf117 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.247542 Jun 03 15:28:49.781978 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 152/285] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:28:49 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:28:49.800593 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2b981dc8-55b2-4046-9783-b3eef5574475 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:49.802058 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2b981dc8-55b2-4046-9783-b3eef5574475 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:49.810890 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2b981dc8-55b2-4046-9783-b3eef5574475 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:49.811753 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2b981dc8-55b2-4046-9783-b3eef5574475 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:49.812986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2b981dc8-55b2-4046-9783-b3eef5574475 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:49.814462 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2b981dc8-55b2-4046-9783-b3eef5574475 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:49.912546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2b981dc8-55b2-4046-9783-b3eef5574475 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:49.927508 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2b981dc8-55b2-4046-9783-b3eef5574475 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1186 microversion: 2.1 time: 0.131135 Jun 03 15:28:49.929681 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 153/286] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:49 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1186 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:50.480416 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-64b1f726-ee7f-4e0d-8bc8-ffcc5e366b7c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:50.481029 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-64b1f726-ee7f-4e0d-8bc8-ffcc5e366b7c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:50.496240 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-64b1f726-ee7f-4e0d-8bc8-ffcc5e366b7c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:50.497651 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-64b1f726-ee7f-4e0d-8bc8-ffcc5e366b7c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:50.503607 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-64b1f726-ee7f-4e0d-8bc8-ffcc5e366b7c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:50.508199 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-64b1f726-ee7f-4e0d-8bc8-ffcc5e366b7c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:50.593791 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f9bdb9b8-438a-4324-bd90-639cd77ad54b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.059616 Jun 03 15:28:50.598970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 134/287] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:28:49 2022] POST /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/os-volume_attachments => generated 194 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:50.805698 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-05392619-0346-4ee1-ae38-36eb5855b089 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:50.806501 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-05392619-0346-4ee1-ae38-36eb5855b089 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:50.817857 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-05392619-0346-4ee1-ae38-36eb5855b089 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:50.818740 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-05392619-0346-4ee1-ae38-36eb5855b089 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:50.820367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-05392619-0346-4ee1-ae38-36eb5855b089 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:50.820889 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-05392619-0346-4ee1-ae38-36eb5855b089 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:50.916902 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-64b1f726-ee7f-4e0d-8bc8-ffcc5e366b7c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:50.938017 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-64b1f726-ee7f-4e0d-8bc8-ffcc5e366b7c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.462076 Jun 03 15:28:50.941776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 154/288] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:50 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:50.947800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-413e91e4-2599-4217-9572-6a4bc59b64be tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:50.948791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-413e91e4-2599-4217-9572-6a4bc59b64be tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:50.955810 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-413e91e4-2599-4217-9572-6a4bc59b64be tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:50.956306 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-413e91e4-2599-4217-9572-6a4bc59b64be tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:50.957421 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-413e91e4-2599-4217-9572-6a4bc59b64be tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:50.957748 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-413e91e4-2599-4217-9572-6a4bc59b64be tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:51.102934 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-413e91e4-2599-4217-9572-6a4bc59b64be tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:51.110822 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-413e91e4-2599-4217-9572-6a4bc59b64be tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1204 microversion: 2.1 time: 0.167722 Jun 03 15:28:51.111853 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 155/289] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:50 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1204 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:51.389826 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-05392619-0346-4ee1-ae38-36eb5855b089 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:51.401263 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-05392619-0346-4ee1-ae38-36eb5855b089 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:51.403386 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-05392619-0346-4ee1-ae38-36eb5855b089 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:51.404772 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-05392619-0346-4ee1-ae38-36eb5855b089 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.605077 Jun 03 15:28:51.405372 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 135/290] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:28:50 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:28:51.451840 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-89e8e975-b5dd-4d69-8d23-e0e7219d518f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1682147940"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:51.452759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-89e8e975-b5dd-4d69-8d23-e0e7219d518f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:51.459980 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89e8e975-b5dd-4d69-8d23-e0e7219d518f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:51.460539 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89e8e975-b5dd-4d69-8d23-e0e7219d518f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:51.462412 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89e8e975-b5dd-4d69-8d23-e0e7219d518f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:51.462896 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89e8e975-b5dd-4d69-8d23-e0e7219d518f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:51.735208 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.network.security_group_api [None req-89e8e975-b5dd-4d69-8d23-e0e7219d518f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Adding security group a693cf21-50d5-4e38-8e93-263cac144c13 to port 3013216d-76f3-469e-9c86-a0bc71687991 Jun 03 15:28:51.957929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-493c8817-254f-4926-9f17-00dc0f933f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:51.958883 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-493c8817-254f-4926-9f17-00dc0f933f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:51.969592 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-493c8817-254f-4926-9f17-00dc0f933f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:51.971192 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-493c8817-254f-4926-9f17-00dc0f933f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:51.973435 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-493c8817-254f-4926-9f17-00dc0f933f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:51.974684 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-493c8817-254f-4926-9f17-00dc0f933f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:52.161889 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-493c8817-254f-4926-9f17-00dc0f933f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:52.179129 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-493c8817-254f-4926-9f17-00dc0f933f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.225715 Jun 03 15:28:52.180416 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 136/291] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:51 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:52.185188 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e1d4f9ac-d8c5-43c1-b657-531d174e686c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:52.186102 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e1d4f9ac-d8c5-43c1-b657-531d174e686c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:52.193917 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e1d4f9ac-d8c5-43c1-b657-531d174e686c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:52.194785 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e1d4f9ac-d8c5-43c1-b657-531d174e686c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:52.196112 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e1d4f9ac-d8c5-43c1-b657-531d174e686c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:52.196779 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e1d4f9ac-d8c5-43c1-b657-531d174e686c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:52.409019 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e1d4f9ac-d8c5-43c1-b657-531d174e686c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:52.421799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e1d4f9ac-d8c5-43c1-b657-531d174e686c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1272 microversion: 2.1 time: 0.239998 Jun 03 15:28:52.422761 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 137/292] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:52 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:52.432964 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-551a7791-957f-40aa-acfd-754b7fcb42d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:52.433888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-551a7791-957f-40aa-acfd-754b7fcb42d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:52.444531 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-551a7791-957f-40aa-acfd-754b7fcb42d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:52.445780 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-551a7791-957f-40aa-acfd-754b7fcb42d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:52.450214 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-551a7791-957f-40aa-acfd-754b7fcb42d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:52.450959 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-551a7791-957f-40aa-acfd-754b7fcb42d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:52.608085 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-89e8e975-b5dd-4d69-8d23-e0e7219d518f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "POST /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/action" status: 202 len: 0 microversion: 2.1 time: 1.161457 Jun 03 15:28:52.609745 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 156/293] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:28:51 2022] POST /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/action => generated 0 bytes in 1164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:28:52.619075 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9e1a5548-b8ba-4572-8024-da71782fb3a5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:52.619697 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9e1a5548-b8ba-4572-8024-da71782fb3a5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:52.632101 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e1a5548-b8ba-4572-8024-da71782fb3a5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:52.632575 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e1a5548-b8ba-4572-8024-da71782fb3a5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:52.634863 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e1a5548-b8ba-4572-8024-da71782fb3a5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:52.635846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e1a5548-b8ba-4572-8024-da71782fb3a5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:52.757562 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-551a7791-957f-40aa-acfd-754b7fcb42d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:52.770857 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-551a7791-957f-40aa-acfd-754b7fcb42d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:52.775097 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-551a7791-957f-40aa-acfd-754b7fcb42d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:52.779326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-551a7791-957f-40aa-acfd-754b7fcb42d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.350937 Jun 03 15:28:52.783506 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 138/294] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:28:52 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:28:52.791440 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-e58f472a-82bb-4d7a-b7d3-57b73929eef5 req-1ce64d2d-d432-49a2-992a-6d56861c903a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f284eb-df90-4337-8bdf-511156b6a756", "tag": "3013216d-76f3-469e-9c86-a0bc71687991"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:52.818494 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-e58f472a-82bb-4d7a-b7d3-57b73929eef5 req-1ce64d2d-d432-49a2-992a-6d56861c903a service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:52.819436 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-e58f472a-82bb-4d7a-b7d3-57b73929eef5 req-1ce64d2d-d432-49a2-992a-6d56861c903a service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:52.853549 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-e58f472a-82bb-4d7a-b7d3-57b73929eef5 req-1ce64d2d-d432-49a2-992a-6d56861c903a service nova] Creating event network-changed:3013216d-76f3-469e-9c86-a0bc71687991 for instance 67f284eb-df90-4337-8bdf-511156b6a756 on hv-cinder-83124 Jun 03 15:28:52.872448 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-e58f472a-82bb-4d7a-b7d3-57b73929eef5 req-1ce64d2d-d432-49a2-992a-6d56861c903a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086106 Jun 03 15:28:52.875968 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 139/295] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:53.198283 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a0b7007f-4b76-4199-89de-860559911342 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:53.199007 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a0b7007f-4b76-4199-89de-860559911342 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:53.209106 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a0b7007f-4b76-4199-89de-860559911342 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:53.221551 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a0b7007f-4b76-4199-89de-860559911342 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:53.223804 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a0b7007f-4b76-4199-89de-860559911342 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:53.224631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a0b7007f-4b76-4199-89de-860559911342 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:53.321054 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9e1a5548-b8ba-4572-8024-da71782fb3a5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:53.335807 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9e1a5548-b8ba-4572-8024-da71782fb3a5 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1758 microversion: 2.1 time: 0.721296 Jun 03 15:28:53.340284 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 157/296] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:52 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1758 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:53.436695 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a0b7007f-4b76-4199-89de-860559911342 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:53.441767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c7cfbe13-33c3-41c7-b1ff-1f1b1c13e1a6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:53.443308 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c7cfbe13-33c3-41c7-b1ff-1f1b1c13e1a6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:53.445252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a0b7007f-4b76-4199-89de-860559911342 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.251898 Jun 03 15:28:53.449566 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 140/297] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:53 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:53.471512 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c7cfbe13-33c3-41c7-b1ff-1f1b1c13e1a6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:53.481827 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c7cfbe13-33c3-41c7-b1ff-1f1b1c13e1a6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:53.484203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c7cfbe13-33c3-41c7-b1ff-1f1b1c13e1a6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:53.485071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c7cfbe13-33c3-41c7-b1ff-1f1b1c13e1a6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:53.508226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:53.805730 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-08196439-ae39-41dd-9057-c5e27759ef72 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:53.806337 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-08196439-ae39-41dd-9057-c5e27759ef72 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:53.818894 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-08196439-ae39-41dd-9057-c5e27759ef72 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:53.819550 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-08196439-ae39-41dd-9057-c5e27759ef72 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:53.820712 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-08196439-ae39-41dd-9057-c5e27759ef72 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:53.821155 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-08196439-ae39-41dd-9057-c5e27759ef72 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:53.842349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c7cfbe13-33c3-41c7-b1ff-1f1b1c13e1a6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:53.853321 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c7cfbe13-33c3-41c7-b1ff-1f1b1c13e1a6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1272 microversion: 2.1 time: 0.416748 Jun 03 15:28:53.864538 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 158/298] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:53 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1272 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:54.110074 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-08196439-ae39-41dd-9057-c5e27759ef72 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:54.122905 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-08196439-ae39-41dd-9057-c5e27759ef72 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:54.126108 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-08196439-ae39-41dd-9057-c5e27759ef72 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:54.127422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-08196439-ae39-41dd-9057-c5e27759ef72 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.325555 Jun 03 15:28:54.129076 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 141/299] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:28:53 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:28:54.466749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6b0e4d1c-1b24-48b7-923d-8a9445870de4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:54.467355 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6b0e4d1c-1b24-48b7-923d-8a9445870de4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:54.477235 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6b0e4d1c-1b24-48b7-923d-8a9445870de4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:54.480048 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6b0e4d1c-1b24-48b7-923d-8a9445870de4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:54.482019 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6b0e4d1c-1b24-48b7-923d-8a9445870de4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:54.484444 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6b0e4d1c-1b24-48b7-923d-8a9445870de4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:54.809624 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6b0e4d1c-1b24-48b7-923d-8a9445870de4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:54.817445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6b0e4d1c-1b24-48b7-923d-8a9445870de4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.354399 Jun 03 15:28:54.818830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 159/300] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:54 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:54.871526 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6e1ea793-00b9-4f4e-b054-951c5e11f02f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:54.873048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6e1ea793-00b9-4f4e-b054-951c5e11f02f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:54.886454 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6e1ea793-00b9-4f4e-b054-951c5e11f02f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:54.887125 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6e1ea793-00b9-4f4e-b054-951c5e11f02f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:54.888416 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6e1ea793-00b9-4f4e-b054-951c5e11f02f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:54.888845 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6e1ea793-00b9-4f4e-b054-951c5e11f02f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:54.905145 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-cf280def-0775-4581-9533-0a8c153d932c req-d72131cc-926d-4804-b5f6-f5d0850b9257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800d0eab-3550-4b55-8837-765681285f77", "tag": "5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:54.922833 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-cf280def-0775-4581-9533-0a8c153d932c req-d72131cc-926d-4804-b5f6-f5d0850b9257 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:54.923614 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-cf280def-0775-4581-9533-0a8c153d932c req-d72131cc-926d-4804-b5f6-f5d0850b9257 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:54.937934 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-cf280def-0775-4581-9533-0a8c153d932c req-d72131cc-926d-4804-b5f6-f5d0850b9257 service nova] Creating event network-changed:5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533 for instance 800d0eab-3550-4b55-8837-765681285f77 on hv-cinder-83124 Jun 03 15:28:54.944117 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-cf280def-0775-4581-9533-0a8c153d932c req-d72131cc-926d-4804-b5f6-f5d0850b9257 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043563 Jun 03 15:28:54.945812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 160/301] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:28:55.133456 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6e1ea793-00b9-4f4e-b054-951c5e11f02f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:55.145292 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6e1ea793-00b9-4f4e-b054-951c5e11f02f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1272 microversion: 2.1 time: 0.278000 Jun 03 15:28:55.146232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 142/302] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:54 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:55.148246 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ee6b2dc2-4ab0-4840-a27e-a9ebd17583f0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:55.157565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ee6b2dc2-4ab0-4840-a27e-a9ebd17583f0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:55.189659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee6b2dc2-4ab0-4840-a27e-a9ebd17583f0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:55.190759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee6b2dc2-4ab0-4840-a27e-a9ebd17583f0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:55.191646 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee6b2dc2-4ab0-4840-a27e-a9ebd17583f0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:55.192106 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee6b2dc2-4ab0-4840-a27e-a9ebd17583f0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:55.196003 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-97eca022-a623-470f-87d3-bd0c3ed7386b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: .version_select at 0x7f92f0e97ca0>, body: {"keypair": {"name": "tempest-keypair-919929934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCBQOMwtH0cU2zgg5H+pFd7Ovb/1tGFXA2JyTDugwnKv6vlJaPcHjLw6QBKpqpd2uznKJQT35kKjwCAeWa2af3VWmMZBcpWou57AgIZ5UqfbHwM0z8DP7VNGocF3WHO6A=="}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:55.234290 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-97eca022-a623-470f-87d3-bd0c3ed7386b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'key_pairs'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:28:55.241473 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-97eca022-a623-470f-87d3-bd0c3ed7386b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for user 193a35a91a47410f8b12cb2e84b33e1f and project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'key_pairs'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:28:55.274758 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-97eca022-a623-470f-87d3-bd0c3ed7386b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081704 Jun 03 15:28:55.275808 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 143/303] 10.222.0.93 () {60 vars in 1158 bytes} [Fri Jun 3 15:28:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:28:55.563886 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ee6b2dc2-4ab0-4840-a27e-a9ebd17583f0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:55.577605 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ee6b2dc2-4ab0-4840-a27e-a9ebd17583f0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:55.579488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ee6b2dc2-4ab0-4840-a27e-a9ebd17583f0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:55.581455 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ee6b2dc2-4ab0-4840-a27e-a9ebd17583f0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.438346 Jun 03 15:28:55.582576 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 161/304] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:28:55 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:28:55.842353 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-073b0a8f-587a-4fa4-86fc-831df7c28d05 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:55.843981 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-073b0a8f-587a-4fa4-86fc-831df7c28d05 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:55.854910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-073b0a8f-587a-4fa4-86fc-831df7c28d05 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:55.855692 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-073b0a8f-587a-4fa4-86fc-831df7c28d05 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:55.856675 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-073b0a8f-587a-4fa4-86fc-831df7c28d05 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:55.857461 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-073b0a8f-587a-4fa4-86fc-831df7c28d05 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:56.014805 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-073b0a8f-587a-4fa4-86fc-831df7c28d05 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:56.023613 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-073b0a8f-587a-4fa4-86fc-831df7c28d05 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.187609 Jun 03 15:28:56.024234 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 144/305] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:55 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:56.165145 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d25a11ae-d5fa-451e-804d-9591080324c3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:56.165730 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d25a11ae-d5fa-451e-804d-9591080324c3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:56.167756 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=68 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:56.176423 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d25a11ae-d5fa-451e-804d-9591080324c3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:56.177073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d25a11ae-d5fa-451e-804d-9591080324c3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:56.178006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d25a11ae-d5fa-451e-804d-9591080324c3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:56.178870 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d25a11ae-d5fa-451e-804d-9591080324c3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:56.428443 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d25a11ae-d5fa-451e-804d-9591080324c3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:56.438781 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d25a11ae-d5fa-451e-804d-9591080324c3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.276859 Jun 03 15:28:56.439776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 162/306] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:56 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:56.600728 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f3a23255-6e87-4c1e-88d5-72b4ce40bb70 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:56.601709 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f3a23255-6e87-4c1e-88d5-72b4ce40bb70 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:56.616535 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f3a23255-6e87-4c1e-88d5-72b4ce40bb70 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:56.616986 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f3a23255-6e87-4c1e-88d5-72b4ce40bb70 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:56.617775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f3a23255-6e87-4c1e-88d5-72b4ce40bb70 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:56.618244 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f3a23255-6e87-4c1e-88d5-72b4ce40bb70 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:56.638058 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:56.778696 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f3a23255-6e87-4c1e-88d5-72b4ce40bb70 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:56.790646 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f3a23255-6e87-4c1e-88d5-72b4ce40bb70 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:56.792328 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f3a23255-6e87-4c1e-88d5-72b4ce40bb70 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:56.793771 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f3a23255-6e87-4c1e-88d5-72b4ce40bb70 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.197856 Jun 03 15:28:56.794417 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 145/307] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:28:56 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:28:57.041843 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c5522a1e-8074-4567-92ad-ee94517b286a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:57.051448 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c5522a1e-8074-4567-92ad-ee94517b286a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:57.052420 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c5522a1e-8074-4567-92ad-ee94517b286a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:57.052988 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c5522a1e-8074-4567-92ad-ee94517b286a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:57.054317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c5522a1e-8074-4567-92ad-ee94517b286a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:57.054786 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c5522a1e-8074-4567-92ad-ee94517b286a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:57.169650 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1105836041", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68719859-5880-402e-b442-370597e1ce2f"}], "security_groups": [{"name": "tempest-securitygroup--745236911"}], "key_name": "tempest-keypair-919929934", "user_data": "}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:57.328569 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] validate_networks() for [('68719859-5880-402e-b442-370597e1ce2f', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:28:57.495559 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c5522a1e-8074-4567-92ad-ee94517b286a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:57.507074 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c5522a1e-8074-4567-92ad-ee94517b286a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.469219 Jun 03 15:28:57.508224 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 163/308] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:57 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:57.513353 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d5285cd9-4630-498a-9bb1-b0c83cc38fb9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:57.513968 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d5285cd9-4630-498a-9bb1-b0c83cc38fb9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:57.520859 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d5285cd9-4630-498a-9bb1-b0c83cc38fb9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:57.521377 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d5285cd9-4630-498a-9bb1-b0c83cc38fb9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:57.522501 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d5285cd9-4630-498a-9bb1-b0c83cc38fb9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:57.523250 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d5285cd9-4630-498a-9bb1-b0c83cc38fb9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:57.751725 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d5285cd9-4630-498a-9bb1-b0c83cc38fb9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:57.767354 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d5285cd9-4630-498a-9bb1-b0c83cc38fb9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.258053 Jun 03 15:28:57.767938 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 164/309] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:57 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:57.813318 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b883befd-2b91-402b-92d8-4a99d524800d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:57.813982 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b883befd-2b91-402b-92d8-4a99d524800d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:57.825497 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b883befd-2b91-402b-92d8-4a99d524800d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:57.825954 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b883befd-2b91-402b-92d8-4a99d524800d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:57.828719 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b883befd-2b91-402b-92d8-4a99d524800d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:57.829188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b883befd-2b91-402b-92d8-4a99d524800d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:57.874514 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:28:57.875224 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:28:57.876066 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:28:57.876647 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:28:57.877249 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:28:57.888543 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:57.889169 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:57.890132 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:57.890949 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:57.912584 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:28:57.918415 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for user 193a35a91a47410f8b12cb2e84b33e1f and project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:28:57.931291 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:28:57.933943 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:28:57.991209 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-49373c94-ced7-46bb-bf12-efd0f0ad7baa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.824297 Jun 03 15:28:57.993382 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 146/310] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:28:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:28:58.005575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-17bdca15-3d2b-468b-bbf4-7292b7ef659d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:58.006452 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-17bdca15-3d2b-468b-bbf4-7292b7ef659d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:58.044362 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b883befd-2b91-402b-92d8-4a99d524800d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:58.056437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b883befd-2b91-402b-92d8-4a99d524800d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:58.059373 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b883befd-2b91-402b-92d8-4a99d524800d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:58.060828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b883befd-2b91-402b-92d8-4a99d524800d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.251776 Jun 03 15:28:58.061848 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 165/311] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:28:57 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:28:58.099314 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-17bdca15-3d2b-468b-bbf4-7292b7ef659d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:58.107690 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-17bdca15-3d2b-468b-bbf4-7292b7ef659d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1241 microversion: 2.1 time: 0.109634 Jun 03 15:28:58.108572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 147/312] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:57 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:58.529296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b15dbc67-2d53-4503-8345-1335ab665b8e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:58.530031 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b15dbc67-2d53-4503-8345-1335ab665b8e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:58.533567 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:58.539208 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b15dbc67-2d53-4503-8345-1335ab665b8e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:58.539663 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b15dbc67-2d53-4503-8345-1335ab665b8e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:58.540630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b15dbc67-2d53-4503-8345-1335ab665b8e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:58.541104 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b15dbc67-2d53-4503-8345-1335ab665b8e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:58.696806 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b15dbc67-2d53-4503-8345-1335ab665b8e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:58.706412 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b15dbc67-2d53-4503-8345-1335ab665b8e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.184586 Jun 03 15:28:58.707041 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 166/313] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:58 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:58.784875 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4b589686-d1d3-4bda-9fe3-0195bd63b617 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:58.785482 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4b589686-d1d3-4bda-9fe3-0195bd63b617 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:58.788211 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:28:58.794638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b589686-d1d3-4bda-9fe3-0195bd63b617 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:58.795091 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b589686-d1d3-4bda-9fe3-0195bd63b617 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:58.795922 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b589686-d1d3-4bda-9fe3-0195bd63b617 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:58.796336 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b589686-d1d3-4bda-9fe3-0195bd63b617 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:58.939754 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4b589686-d1d3-4bda-9fe3-0195bd63b617 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:58.948420 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4b589686-d1d3-4bda-9fe3-0195bd63b617 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.167464 Jun 03 15:28:58.949047 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 148/314] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:58 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:59.080710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2185557f-0855-4501-99fd-bd38f6a1a678 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:59.082102 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2185557f-0855-4501-99fd-bd38f6a1a678 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:59.088414 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2185557f-0855-4501-99fd-bd38f6a1a678 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:59.088866 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2185557f-0855-4501-99fd-bd38f6a1a678 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:59.089700 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2185557f-0855-4501-99fd-bd38f6a1a678 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:59.090063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2185557f-0855-4501-99fd-bd38f6a1a678 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:59.125651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7415fe07-deea-43ee-bd7f-c682396dee98 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:59.126437 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7415fe07-deea-43ee-bd7f-c682396dee98 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:59.133614 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7415fe07-deea-43ee-bd7f-c682396dee98 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:59.134649 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7415fe07-deea-43ee-bd7f-c682396dee98 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:59.135745 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7415fe07-deea-43ee-bd7f-c682396dee98 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:59.136368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7415fe07-deea-43ee-bd7f-c682396dee98 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:59.204759 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7415fe07-deea-43ee-bd7f-c682396dee98 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:59.215719 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7415fe07-deea-43ee-bd7f-c682396dee98 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1293 microversion: 2.1 time: 0.094198 Jun 03 15:28:59.217172 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 149/315] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:59 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:28:59.285347 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2185557f-0855-4501-99fd-bd38f6a1a678 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:59.294305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2185557f-0855-4501-99fd-bd38f6a1a678 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:59.295970 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2185557f-0855-4501-99fd-bd38f6a1a678 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:59.297280 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2185557f-0855-4501-99fd-bd38f6a1a678 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.220623 Jun 03 15:28:59.298252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 167/316] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:28:59 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:28:59.723585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0468aa73-dd11-418b-b919-ea603aba6154 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:59.724197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0468aa73-dd11-418b-b919-ea603aba6154 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:59.730348 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0468aa73-dd11-418b-b919-ea603aba6154 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:59.730808 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0468aa73-dd11-418b-b919-ea603aba6154 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:59.731577 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0468aa73-dd11-418b-b919-ea603aba6154 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:59.732075 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0468aa73-dd11-418b-b919-ea603aba6154 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:59.934618 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0468aa73-dd11-418b-b919-ea603aba6154 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:28:59.943822 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0468aa73-dd11-418b-b919-ea603aba6154 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1502 microversion: 2.1 time: 0.224633 Jun 03 15:28:59.945197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 150/317] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:59 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:28:59.962289 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8b59bdd3-b01e-41c3-bc19-d1754d041a53 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "743d4bd8-365b-42a9-be53-cdc09b554b5e"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:28:59.963672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8b59bdd3-b01e-41c3-bc19-d1754d041a53 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:59.963974 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ceda977c-bc0e-42a6-8659-425f5526455d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:28:59.964583 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ceda977c-bc0e-42a6-8659-425f5526455d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:28:59.971750 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ceda977c-bc0e-42a6-8659-425f5526455d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:59.972410 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ceda977c-bc0e-42a6-8659-425f5526455d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:59.973470 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ceda977c-bc0e-42a6-8659-425f5526455d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:59.974159 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8b59bdd3-b01e-41c3-bc19-d1754d041a53 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:59.974647 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ceda977c-bc0e-42a6-8659-425f5526455d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:59.976038 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8b59bdd3-b01e-41c3-bc19-d1754d041a53 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:28:59.978216 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8b59bdd3-b01e-41c3-bc19-d1754d041a53 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:28:59.979262 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8b59bdd3-b01e-41c3-bc19-d1754d041a53 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:00.020448 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-8b59bdd3-b01e-41c3-bc19-d1754d041a53 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] HTTP exception thrown: Cannot 'attach_volume' instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 while it is in vm_state rescued Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8b59bdd3-b01e-41c3-bc19-d1754d041a53 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Request method failure captured: Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: POST /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3/os-volume_attachments HTTP/1.1 Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 74 Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimihFnnSpT9vHcDE8w6rETruaBiPqie-4gBLlICtuPxNIrX0L7M8mdfgmZlPQf6rvIjW8Fnhg2auvD99GfAJ0MDd3ZgsJRSnPycIpx0d5syjzQnhKJUa-jr3zhJXj3ZKMz4Ll2eHi5iI_vUx_dL-hj77lNzuSckrOXnuBrt6wdhuCS6g Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: a402ec1153624838be07cda58279f2a4 Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:29:00.023418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a402ec1153624838be07cda58279f2a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a402ec1153624838be07cda58279f2a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a402ec1153624838be07cda58279f2a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a402ec1153624838be07cda58279f2a4"}]}] Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: a402ec1153624838be07cda58279f2a4 Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-ServerRescueNegativeTestJSON-2095995501-project Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 127a6938bc5c4416a9a502d9064344cd Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2095995501-project Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {"volumeAttachment": {"volumeId": "743d4bd8-365b-42a9-be53-cdc09b554b5e"}} Jun 03 15:29:00.024767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Cannot 'attach_volume' instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 while it is in vm_state rescued Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'server_id': 'cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3', 'body': {'volumeAttachment': {'volumeId': '743d4bd8-365b-42a9-be53-cdc09b554b5e'}}} Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:29:00.025499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 while it is in vm_state rescued Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:29:00.026743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:29:00.031546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:29:00.031546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:29:00.031546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 while it is in vm_state rescued Jun 03 15:29:00.031546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:29:00.031546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8b59bdd3-b01e-41c3-bc19-d1754d041a53 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Returning 409 to user: Cannot 'attach_volume' instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 while it is in vm_state rescued {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:29:00.031546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8b59bdd3-b01e-41c3-bc19-d1754d041a53 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067248 Jun 03 15:29:00.031546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 168/318] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:28:59 2022] POST /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 15:29:00.039223 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1d0b2111-91f5-47e6-90b3-3691110069f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:00.039842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1d0b2111-91f5-47e6-90b3-3691110069f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:00.046011 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1d0b2111-91f5-47e6-90b3-3691110069f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:00.046468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1d0b2111-91f5-47e6-90b3-3691110069f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:00.047275 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1d0b2111-91f5-47e6-90b3-3691110069f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:00.047714 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1d0b2111-91f5-47e6-90b3-3691110069f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:00.121235 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1d0b2111-91f5-47e6-90b3-3691110069f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3/action" status: 202 len: 0 microversion: 2.1 time: 0.087895 Jun 03 15:29:00.121974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 169/319] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:29:00 2022] POST /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:29:00.131814 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1162bf93-fa23-4ae2-ac2e-79d8c21c8635 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:00.132877 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1162bf93-fa23-4ae2-ac2e-79d8c21c8635 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:00.143403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1162bf93-fa23-4ae2-ac2e-79d8c21c8635 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:00.144593 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1162bf93-fa23-4ae2-ac2e-79d8c21c8635 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:00.146059 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1162bf93-fa23-4ae2-ac2e-79d8c21c8635 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:00.149908 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1162bf93-fa23-4ae2-ac2e-79d8c21c8635 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:00.232350 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ceda977c-bc0e-42a6-8659-425f5526455d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:00.240980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ceda977c-bc0e-42a6-8659-425f5526455d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.280777 Jun 03 15:29:00.242272 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 151/320] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:28:59 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:00.248610 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9e9dd4ca-1f2c-40f5-b318-aaaa218f71bb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:00.249422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9e9dd4ca-1f2c-40f5-b318-aaaa218f71bb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:00.257110 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9e9dd4ca-1f2c-40f5-b318-aaaa218f71bb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:00.257767 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9e9dd4ca-1f2c-40f5-b318-aaaa218f71bb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:00.258683 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9e9dd4ca-1f2c-40f5-b318-aaaa218f71bb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:00.259123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9e9dd4ca-1f2c-40f5-b318-aaaa218f71bb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:00.338401 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9e9dd4ca-1f2c-40f5-b318-aaaa218f71bb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:00.346744 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9e9dd4ca-1f2c-40f5-b318-aaaa218f71bb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1299 microversion: 2.1 time: 0.103064 Jun 03 15:29:00.348475 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 152/321] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:00 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:00.354004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9fb2ce74-e204-4c53-9867-103c8afa072d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:00.355078 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9fb2ce74-e204-4c53-9867-103c8afa072d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:00.364417 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9fb2ce74-e204-4c53-9867-103c8afa072d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:00.365218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9fb2ce74-e204-4c53-9867-103c8afa072d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:00.366863 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9fb2ce74-e204-4c53-9867-103c8afa072d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:00.367659 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9fb2ce74-e204-4c53-9867-103c8afa072d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:00.423176 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1162bf93-fa23-4ae2-ac2e-79d8c21c8635 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:00.436344 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1162bf93-fa23-4ae2-ac2e-79d8c21c8635 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1510 microversion: 2.1 time: 0.309996 Jun 03 15:29:00.436918 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 170/322] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:00 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:00.626193 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9fb2ce74-e204-4c53-9867-103c8afa072d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:00.634947 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9fb2ce74-e204-4c53-9867-103c8afa072d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:00.640661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9fb2ce74-e204-4c53-9867-103c8afa072d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:00.641983 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9fb2ce74-e204-4c53-9867-103c8afa072d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.292183 Jun 03 15:29:00.645102 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 153/323] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:00 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:01.257707 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c1cc8c43-563b-4161-9467-e89b89d7cc10 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:01.262809 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c1cc8c43-563b-4161-9467-e89b89d7cc10 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:01.276282 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c1cc8c43-563b-4161-9467-e89b89d7cc10 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:01.278614 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c1cc8c43-563b-4161-9467-e89b89d7cc10 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:01.287537 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c1cc8c43-563b-4161-9467-e89b89d7cc10 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:01.287537 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c1cc8c43-563b-4161-9467-e89b89d7cc10 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:01.375326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2651fbc6-a0ec-463e-918e-3452e59087c4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:01.375326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2651fbc6-a0ec-463e-918e-3452e59087c4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:01.387556 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2651fbc6-a0ec-463e-918e-3452e59087c4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:01.388162 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2651fbc6-a0ec-463e-918e-3452e59087c4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:01.389051 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2651fbc6-a0ec-463e-918e-3452e59087c4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:01.389585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2651fbc6-a0ec-463e-918e-3452e59087c4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:01.553876 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c1cc8c43-563b-4161-9467-e89b89d7cc10 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:01.569271 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c1cc8c43-563b-4161-9467-e89b89d7cc10 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.314328 Jun 03 15:29:01.570417 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 171/324] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:01 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:01.576543 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b28e531b-0ed8-46d9-a911-e7c922403524 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:01.577888 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b28e531b-0ed8-46d9-a911-e7c922403524 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:01.588517 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b28e531b-0ed8-46d9-a911-e7c922403524 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:01.589737 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b28e531b-0ed8-46d9-a911-e7c922403524 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:01.590831 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b28e531b-0ed8-46d9-a911-e7c922403524 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:01.592349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b28e531b-0ed8-46d9-a911-e7c922403524 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:01.689322 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2651fbc6-a0ec-463e-918e-3452e59087c4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:01.702903 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2651fbc6-a0ec-463e-918e-3452e59087c4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.340897 Jun 03 15:29:01.711059 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 154/325] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:01 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:01.717135 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7875e69b-2821-40bd-9aa7-8c6966a99c80 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:01.717755 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7875e69b-2821-40bd-9aa7-8c6966a99c80 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:01.728575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7875e69b-2821-40bd-9aa7-8c6966a99c80 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:01.729041 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7875e69b-2821-40bd-9aa7-8c6966a99c80 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:01.729849 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7875e69b-2821-40bd-9aa7-8c6966a99c80 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:01.731347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7875e69b-2821-40bd-9aa7-8c6966a99c80 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:01.953962 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7875e69b-2821-40bd-9aa7-8c6966a99c80 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:01.967175 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7875e69b-2821-40bd-9aa7-8c6966a99c80 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:01.971235 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7875e69b-2821-40bd-9aa7-8c6966a99c80 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:01.972642 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7875e69b-2821-40bd-9aa7-8c6966a99c80 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.260179 Jun 03 15:29:01.973452 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 155/326] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:01 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:01.977093 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b28e531b-0ed8-46d9-a911-e7c922403524 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:01.985663 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b28e531b-0ed8-46d9-a911-e7c922403524 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1510 microversion: 2.1 time: 0.413900 Jun 03 15:29:01.996089 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 172/327] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:01 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1510 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:02.183231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-0b50466d-5bbe-4147-99b8-9b2dd6254533 req-34fa1552-3411-40ce-870f-464f7f2f7d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2", "tag": "343d88d0-4f0d-4021-bfee-efee56348782"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:02.197132 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-0b50466d-5bbe-4147-99b8-9b2dd6254533 req-34fa1552-3411-40ce-870f-464f7f2f7d6c service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:02.200591 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-0b50466d-5bbe-4147-99b8-9b2dd6254533 req-34fa1552-3411-40ce-870f-464f7f2f7d6c service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:02.229549 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-0b50466d-5bbe-4147-99b8-9b2dd6254533 req-34fa1552-3411-40ce-870f-464f7f2f7d6c service nova] Creating event network-changed:343d88d0-4f0d-4021-bfee-efee56348782 for instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 on hv-cinder-83124 Jun 03 15:29:02.250686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-0b50466d-5bbe-4147-99b8-9b2dd6254533 req-34fa1552-3411-40ce-870f-464f7f2f7d6c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070955 Jun 03 15:29:02.253947 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 156/328] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:29:02.587281 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-90347f6f-3ffb-4eab-800e-d623d98ab128 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:02.588015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-90347f6f-3ffb-4eab-800e-d623d98ab128 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:02.596208 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90347f6f-3ffb-4eab-800e-d623d98ab128 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:02.597416 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90347f6f-3ffb-4eab-800e-d623d98ab128 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:02.598418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90347f6f-3ffb-4eab-800e-d623d98ab128 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:02.598983 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90347f6f-3ffb-4eab-800e-d623d98ab128 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:02.729427 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cf463900-2201-4b79-ae8f-7e2d1969ef77 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:02.730142 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-cf463900-2201-4b79-ae8f-7e2d1969ef77 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:02.742040 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cf463900-2201-4b79-ae8f-7e2d1969ef77 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:02.742506 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cf463900-2201-4b79-ae8f-7e2d1969ef77 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:02.745552 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cf463900-2201-4b79-ae8f-7e2d1969ef77 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:02.746800 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cf463900-2201-4b79-ae8f-7e2d1969ef77 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:02.798160 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-90347f6f-3ffb-4eab-800e-d623d98ab128 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:02.806577 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-90347f6f-3ffb-4eab-800e-d623d98ab128 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.224678 Jun 03 15:29:02.807566 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 173/329] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:02 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:02.902055 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-cf463900-2201-4b79-ae8f-7e2d1969ef77 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:02.909671 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-cf463900-2201-4b79-ae8f-7e2d1969ef77 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.185252 Jun 03 15:29:02.910714 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 157/330] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:02 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:02.991755 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d4b2c534-5c91-4ef5-85b0-ef8ba543295f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:02.992589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d4b2c534-5c91-4ef5-85b0-ef8ba543295f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:03.000124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d4b2c534-5c91-4ef5-85b0-ef8ba543295f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:03.000696 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d4b2c534-5c91-4ef5-85b0-ef8ba543295f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:03.001571 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d4b2c534-5c91-4ef5-85b0-ef8ba543295f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:03.002196 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d4b2c534-5c91-4ef5-85b0-ef8ba543295f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:03.005447 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6f302272-407c-44a6-bd9c-407fbc2d834d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:03.006715 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6f302272-407c-44a6-bd9c-407fbc2d834d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:03.014210 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6f302272-407c-44a6-bd9c-407fbc2d834d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:03.014904 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6f302272-407c-44a6-bd9c-407fbc2d834d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:03.018903 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6f302272-407c-44a6-bd9c-407fbc2d834d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:03.019560 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6f302272-407c-44a6-bd9c-407fbc2d834d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:03.163057 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d4b2c534-5c91-4ef5-85b0-ef8ba543295f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:03.166116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:03.179058 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6f302272-407c-44a6-bd9c-407fbc2d834d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:03.179217 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d4b2c534-5c91-4ef5-85b0-ef8ba543295f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:03.180805 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d4b2c534-5c91-4ef5-85b0-ef8ba543295f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:03.182146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d4b2c534-5c91-4ef5-85b0-ef8ba543295f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.194499 Jun 03 15:29:03.182891 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 174/331] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:02 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:03.197062 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6f302272-407c-44a6-bd9c-407fbc2d834d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1510 microversion: 2.1 time: 0.197593 Jun 03 15:29:03.197963 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 158/332] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:02 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:03.825501 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-43d0e62f-d735-4d1d-a206-b716a2c31826 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:03.826095 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-43d0e62f-d735-4d1d-a206-b716a2c31826 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:03.833446 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-43d0e62f-d735-4d1d-a206-b716a2c31826 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:03.833888 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-43d0e62f-d735-4d1d-a206-b716a2c31826 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:03.834668 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-43d0e62f-d735-4d1d-a206-b716a2c31826 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:03.835324 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-43d0e62f-d735-4d1d-a206-b716a2c31826 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:03.927555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-49936824-58ce-4bd9-a6a3-4f7b0d7d41b6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:03.928238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-49936824-58ce-4bd9-a6a3-4f7b0d7d41b6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:03.953746 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-49936824-58ce-4bd9-a6a3-4f7b0d7d41b6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:03.954956 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-49936824-58ce-4bd9-a6a3-4f7b0d7d41b6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:03.956374 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-49936824-58ce-4bd9-a6a3-4f7b0d7d41b6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:03.956800 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-49936824-58ce-4bd9-a6a3-4f7b0d7d41b6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:03.986098 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-43d0e62f-d735-4d1d-a206-b716a2c31826 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:03.994508 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-43d0e62f-d735-4d1d-a206-b716a2c31826 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.172847 Jun 03 15:29:03.995302 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 175/333] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:03 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:04.088657 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-49936824-58ce-4bd9-a6a3-4f7b0d7d41b6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:04.097281 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-49936824-58ce-4bd9-a6a3-4f7b0d7d41b6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.173825 Jun 03 15:29:04.097845 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 159/334] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:03 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:04.201043 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e6915527-5f51-4b11-b16e-1df531a723df tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:04.201643 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e6915527-5f51-4b11-b16e-1df531a723df tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:04.208204 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6915527-5f51-4b11-b16e-1df531a723df tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:04.208662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6915527-5f51-4b11-b16e-1df531a723df tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:04.209760 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6915527-5f51-4b11-b16e-1df531a723df tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:04.210198 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6915527-5f51-4b11-b16e-1df531a723df tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:04.214136 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-26ba0852-6d9f-4873-9799-b5a3722f82ce tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:04.214769 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-26ba0852-6d9f-4873-9799-b5a3722f82ce tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:04.221377 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-26ba0852-6d9f-4873-9799-b5a3722f82ce tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:04.222361 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-26ba0852-6d9f-4873-9799-b5a3722f82ce tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:04.223161 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-26ba0852-6d9f-4873-9799-b5a3722f82ce tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:04.223591 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-26ba0852-6d9f-4873-9799-b5a3722f82ce tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:04.349739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e6915527-5f51-4b11-b16e-1df531a723df tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:04.358822 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e6915527-5f51-4b11-b16e-1df531a723df tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:04.360321 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e6915527-5f51-4b11-b16e-1df531a723df tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:04.361482 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e6915527-5f51-4b11-b16e-1df531a723df tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.164331 Jun 03 15:29:04.362031 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 176/335] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:04 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:04.363695 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-26ba0852-6d9f-4873-9799-b5a3722f82ce tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:04.371451 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-26ba0852-6d9f-4873-9799-b5a3722f82ce tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1510 microversion: 2.1 time: 0.161111 Jun 03 15:29:04.372007 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 160/336] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:04 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:05.013730 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0b01703c-6fb6-43e0-82c9-335da0ab9aee tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:05.014751 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0b01703c-6fb6-43e0-82c9-335da0ab9aee tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:05.026456 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0b01703c-6fb6-43e0-82c9-335da0ab9aee tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:05.029406 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0b01703c-6fb6-43e0-82c9-335da0ab9aee tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:05.030362 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0b01703c-6fb6-43e0-82c9-335da0ab9aee tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:05.030850 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0b01703c-6fb6-43e0-82c9-335da0ab9aee tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:05.118732 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ad48ba96-6100-4d9e-9bd7-483c4071afb0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:05.120330 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ad48ba96-6100-4d9e-9bd7-483c4071afb0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:05.127932 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad48ba96-6100-4d9e-9bd7-483c4071afb0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:05.128712 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad48ba96-6100-4d9e-9bd7-483c4071afb0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:05.129672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad48ba96-6100-4d9e-9bd7-483c4071afb0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:05.130103 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad48ba96-6100-4d9e-9bd7-483c4071afb0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:05.198301 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0b01703c-6fb6-43e0-82c9-335da0ab9aee tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:05.213888 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0b01703c-6fb6-43e0-82c9-335da0ab9aee tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.205775 Jun 03 15:29:05.214479 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 177/337] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:05 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:05.380339 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7e95e0d7-3cf8-48a0-955e-5bcbecb0986c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:05.381283 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7e95e0d7-3cf8-48a0-955e-5bcbecb0986c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:05.388212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7e95e0d7-3cf8-48a0-955e-5bcbecb0986c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:05.388965 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7e95e0d7-3cf8-48a0-955e-5bcbecb0986c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:05.389749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7e95e0d7-3cf8-48a0-955e-5bcbecb0986c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:05.390366 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7e95e0d7-3cf8-48a0-955e-5bcbecb0986c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:05.505632 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ad48ba96-6100-4d9e-9bd7-483c4071afb0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:05.512980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ad48ba96-6100-4d9e-9bd7-483c4071afb0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.402735 Jun 03 15:29:05.513557 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 161/338] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:05 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:05.524971 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2e2ed1c0-d22c-4053-93bf-e133415ccbd8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:05.526022 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2e2ed1c0-d22c-4053-93bf-e133415ccbd8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:05.533224 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2e2ed1c0-d22c-4053-93bf-e133415ccbd8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:05.534278 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2e2ed1c0-d22c-4053-93bf-e133415ccbd8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:05.535182 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2e2ed1c0-d22c-4053-93bf-e133415ccbd8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:05.535871 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2e2ed1c0-d22c-4053-93bf-e133415ccbd8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:05.570738 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7e95e0d7-3cf8-48a0-955e-5bcbecb0986c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:05.579271 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7e95e0d7-3cf8-48a0-955e-5bcbecb0986c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:05.581750 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7e95e0d7-3cf8-48a0-955e-5bcbecb0986c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:05.584147 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7e95e0d7-3cf8-48a0-955e-5bcbecb0986c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.208051 Jun 03 15:29:05.585109 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 178/339] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:05 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:29:05.681693 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2e2ed1c0-d22c-4053-93bf-e133415ccbd8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:05.691029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2e2ed1c0-d22c-4053-93bf-e133415ccbd8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1516 microversion: 2.1 time: 0.171714 Jun 03 15:29:05.691774 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 162/340] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:05 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:06.070299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ecde71c8-f443-4b1c-bcc8-2d2804ae9677 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:06.095799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ecde71c8-f443-4b1c-bcc8-2d2804ae9677 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:06.096896 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ecde71c8-f443-4b1c-bcc8-2d2804ae9677 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:06.169245 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ecde71c8-f443-4b1c-bcc8-2d2804ae9677 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Going to try to stop instance {{(pid=117806) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 15:29:06.232798 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9f871ee8-0b3f-4210-91ba-81a6cefa6f80 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:06.233416 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9f871ee8-0b3f-4210-91ba-81a6cefa6f80 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:06.240176 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ecde71c8-f443-4b1c-bcc8-2d2804ae9677 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/action" status: 202 len: 0 microversion: 2.1 time: 0.174065 Jun 03 15:29:06.240447 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9f871ee8-0b3f-4210-91ba-81a6cefa6f80 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:06.244774 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9f871ee8-0b3f-4210-91ba-81a6cefa6f80 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:06.244928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 179/341] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:29:06 2022] POST /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:29:06.245059 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9f871ee8-0b3f-4210-91ba-81a6cefa6f80 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:06.245059 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9f871ee8-0b3f-4210-91ba-81a6cefa6f80 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:06.250762 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-12748edb-abe2-4503-821b-5f8b6bdfc74c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:06.251683 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-12748edb-abe2-4503-821b-5f8b6bdfc74c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:06.259285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-12748edb-abe2-4503-821b-5f8b6bdfc74c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:06.259867 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-12748edb-abe2-4503-821b-5f8b6bdfc74c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:06.260655 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-12748edb-abe2-4503-821b-5f8b6bdfc74c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:06.261149 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-12748edb-abe2-4503-821b-5f8b6bdfc74c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:06.415641 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-12748edb-abe2-4503-821b-5f8b6bdfc74c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:06.422052 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9f871ee8-0b3f-4210-91ba-81a6cefa6f80 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:06.429075 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-12748edb-abe2-4503-821b-5f8b6bdfc74c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.183268 Jun 03 15:29:06.429656 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 180/342] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:06 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:06.430668 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9f871ee8-0b3f-4210-91ba-81a6cefa6f80 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.202851 Jun 03 15:29:06.431081 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 163/343] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:06 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:06.530432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ee0bb321-9a71-4866-952c-3988a8dd1a2d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:06.531041 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ee0bb321-9a71-4866-952c-3988a8dd1a2d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:06.537582 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee0bb321-9a71-4866-952c-3988a8dd1a2d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:06.538027 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee0bb321-9a71-4866-952c-3988a8dd1a2d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:06.538806 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee0bb321-9a71-4866-952c-3988a8dd1a2d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:06.539410 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee0bb321-9a71-4866-952c-3988a8dd1a2d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:06.604025 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f452fe23-d081-47d4-a560-9c72216d7c09 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:06.604994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f452fe23-d081-47d4-a560-9c72216d7c09 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:06.611603 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f452fe23-d081-47d4-a560-9c72216d7c09 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:06.612613 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f452fe23-d081-47d4-a560-9c72216d7c09 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:06.613380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f452fe23-d081-47d4-a560-9c72216d7c09 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:06.614012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f452fe23-d081-47d4-a560-9c72216d7c09 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:06.629455 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=100 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:06.705693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ee0bb321-9a71-4866-952c-3988a8dd1a2d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:06.714146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ee0bb321-9a71-4866-952c-3988a8dd1a2d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.187442 Jun 03 15:29:06.714760 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 181/344] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:06 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:06.769025 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f452fe23-d081-47d4-a560-9c72216d7c09 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:06.777465 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f452fe23-d081-47d4-a560-9c72216d7c09 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:06.779006 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f452fe23-d081-47d4-a560-9c72216d7c09 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:06.780164 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f452fe23-d081-47d4-a560-9c72216d7c09 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.180881 Jun 03 15:29:06.780908 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 164/345] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:06 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:06.919307 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-7d4a3773-4a37-4b59-8d02-43c6616f92e2 req-eb4dadca-68dc-47df-96ec-50e42f7c08b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800d0eab-3550-4b55-8837-765681285f77", "name": "network-vif-plugged", "status": "completed", "tag": "5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:06.928472 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-7d4a3773-4a37-4b59-8d02-43c6616f92e2 req-eb4dadca-68dc-47df-96ec-50e42f7c08b6 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:06.929069 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-7d4a3773-4a37-4b59-8d02-43c6616f92e2 req-eb4dadca-68dc-47df-96ec-50e42f7c08b6 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:06.941167 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-7d4a3773-4a37-4b59-8d02-43c6616f92e2 req-eb4dadca-68dc-47df-96ec-50e42f7c08b6 service nova] Creating event network-vif-plugged:5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533 for instance 800d0eab-3550-4b55-8837-765681285f77 on hv-cinder-83124 Jun 03 15:29:06.946921 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-7d4a3773-4a37-4b59-8d02-43c6616f92e2 req-eb4dadca-68dc-47df-96ec-50e42f7c08b6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031090 Jun 03 15:29:06.947769 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 182/346] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:29:07.157819 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-44d1434c-e50b-46cf-a9b8-81667243aa13 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'create', calling method: .version_select at 0x7f92f0edea60>, body: {"keypair": {"name": "tempest-keypair-1189744404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQdGx9wX18G11bDjqdm5uF4Jv0NMHBhQI0LVvxuLLk8KapYG/pK/kLvR5+g6hQ9FeRayi6daiRTZnhglIKFtgtIY4H5w4PWyElOJTXO7j6foV4cp3LZxjbk71fNK/1fpg=="}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:07.173734 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-44d1434c-e50b-46cf-a9b8-81667243aa13 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Getting quotas for project a402ec1153624838be07cda58279f2a4. Resources: {'key_pairs'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:29:07.177885 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-44d1434c-e50b-46cf-a9b8-81667243aa13 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Getting quotas for user 127a6938bc5c4416a9a502d9064344cd and project a402ec1153624838be07cda58279f2a4. Resources: {'key_pairs'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:29:07.207157 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-44d1434c-e50b-46cf-a9b8-81667243aa13 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051727 Jun 03 15:29:07.208326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 165/347] 10.222.0.93 () {60 vars in 1158 bytes} [Fri Jun 3 15:29:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:29:07.449366 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-831435a5-6c82-41d5-9adc-d1eac52529e3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:07.450947 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-831435a5-6c82-41d5-9adc-d1eac52529e3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:07.452760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-dc5d7f7c-6d52-49e7-a552-c09dfcc07fc8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:07.454696 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-dc5d7f7c-6d52-49e7-a552-c09dfcc07fc8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:07.459978 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-831435a5-6c82-41d5-9adc-d1eac52529e3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:07.460830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-831435a5-6c82-41d5-9adc-d1eac52529e3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:07.461833 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-831435a5-6c82-41d5-9adc-d1eac52529e3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:07.462467 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-831435a5-6c82-41d5-9adc-d1eac52529e3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:07.468328 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc5d7f7c-6d52-49e7-a552-c09dfcc07fc8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:07.468328 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc5d7f7c-6d52-49e7-a552-c09dfcc07fc8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:07.468570 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc5d7f7c-6d52-49e7-a552-c09dfcc07fc8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:07.470200 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc5d7f7c-6d52-49e7-a552-c09dfcc07fc8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:07.676306 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-831435a5-6c82-41d5-9adc-d1eac52529e3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:07.688982 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-831435a5-6c82-41d5-9adc-d1eac52529e3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.245127 Jun 03 15:29:07.695336 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 183/348] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:07 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:07.712253 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dc5d7f7c-6d52-49e7-a552-c09dfcc07fc8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:07.721534 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-dc5d7f7c-6d52-49e7-a552-c09dfcc07fc8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.275736 Jun 03 15:29:07.722477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 166/349] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:07 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:07.735507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-66f83514-2805-4200-b12d-ddd1153eb12c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:07.736335 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-66f83514-2805-4200-b12d-ddd1153eb12c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:07.742996 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-66f83514-2805-4200-b12d-ddd1153eb12c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:07.743485 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-66f83514-2805-4200-b12d-ddd1153eb12c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:07.744300 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-66f83514-2805-4200-b12d-ddd1153eb12c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:07.744783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-66f83514-2805-4200-b12d-ddd1153eb12c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:07.800697 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-67a92e27-972e-4b25-9495-1e3f8bfd56c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:07.801724 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-67a92e27-972e-4b25-9495-1e3f8bfd56c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:07.809528 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-67a92e27-972e-4b25-9495-1e3f8bfd56c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:07.810295 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-67a92e27-972e-4b25-9495-1e3f8bfd56c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:07.811336 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-67a92e27-972e-4b25-9495-1e3f8bfd56c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:07.811747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-67a92e27-972e-4b25-9495-1e3f8bfd56c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:07.900507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=4 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:07.961324 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-66f83514-2805-4200-b12d-ddd1153eb12c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:07.971569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-66f83514-2805-4200-b12d-ddd1153eb12c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.242878 Jun 03 15:29:07.972988 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 184/350] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:07 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:08.087520 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-67a92e27-972e-4b25-9495-1e3f8bfd56c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:08.095944 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-67a92e27-972e-4b25-9495-1e3f8bfd56c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:08.098381 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-67a92e27-972e-4b25-9495-1e3f8bfd56c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:08.099934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-67a92e27-972e-4b25-9495-1e3f8bfd56c3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.304081 Jun 03 15:29:08.100521 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 167/351] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:07 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:29:08.711337 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-07cdaab4-1b5a-44cf-963c-bdc3c499a280 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:08.712543 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-07cdaab4-1b5a-44cf-963c-bdc3c499a280 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:08.719220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-07cdaab4-1b5a-44cf-963c-bdc3c499a280 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:08.719677 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-07cdaab4-1b5a-44cf-963c-bdc3c499a280 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:08.720458 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-07cdaab4-1b5a-44cf-963c-bdc3c499a280 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:08.720925 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-07cdaab4-1b5a-44cf-963c-bdc3c499a280 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:08.739914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-61725c98-c2c1-438b-9596-2666519c0c71 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:08.745506 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-61725c98-c2c1-438b-9596-2666519c0c71 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:08.753675 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-61725c98-c2c1-438b-9596-2666519c0c71 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:08.754148 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-61725c98-c2c1-438b-9596-2666519c0c71 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:08.754952 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-61725c98-c2c1-438b-9596-2666519c0c71 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:08.755386 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-61725c98-c2c1-438b-9596-2666519c0c71 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:08.875277 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-07cdaab4-1b5a-44cf-963c-bdc3c499a280 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:08.883951 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-07cdaab4-1b5a-44cf-963c-bdc3c499a280 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1260 microversion: 2.1 time: 0.176433 Jun 03 15:29:08.884521 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 185/352] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:08 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:08.894347 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1159500418", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba66765f-7c24-4296-be5e-4c2a803ccabf"}], "security_groups": [{"name": "tempest-securitygroup--1234814998"}], "key_name": "tempest-keypair-1189744404", "user_data": "}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:08.910156 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-61725c98-c2c1-438b-9596-2666519c0c71 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:08.918706 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-61725c98-c2c1-438b-9596-2666519c0c71 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.183059 Jun 03 15:29:08.919275 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 168/353] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:08 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:08.989470 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-24db1a1b-b686-4ec1-89b5-48d78973e3b9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:08.990084 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-24db1a1b-b686-4ec1-89b5-48d78973e3b9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:08.996099 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-24db1a1b-b686-4ec1-89b5-48d78973e3b9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:08.996554 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-24db1a1b-b686-4ec1-89b5-48d78973e3b9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:08.997324 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-24db1a1b-b686-4ec1-89b5-48d78973e3b9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:08.997520 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.network.neutron [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] validate_networks() for [('ba66765f-7c24-4296-be5e-4c2a803ccabf', None, None, None, None, None)] {{(pid=117806) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:29:08.997763 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-24db1a1b-b686-4ec1-89b5-48d78973e3b9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:09.127329 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-24db1a1b-b686-4ec1-89b5-48d78973e3b9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:09.135883 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-24db1a1b-b686-4ec1-89b5-48d78973e3b9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.150673 Jun 03 15:29:09.136686 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 169/354] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:08 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:09.141615 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-dc784ee4-c72f-48ce-a47d-67035c91cfc4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:09.142312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-dc784ee4-c72f-48ce-a47d-67035c91cfc4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:09.148949 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc784ee4-c72f-48ce-a47d-67035c91cfc4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:09.149465 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc784ee4-c72f-48ce-a47d-67035c91cfc4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:09.150354 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc784ee4-c72f-48ce-a47d-67035c91cfc4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:09.150816 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc784ee4-c72f-48ce-a47d-67035c91cfc4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:09.282786 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dc784ee4-c72f-48ce-a47d-67035c91cfc4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:09.291982 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dc784ee4-c72f-48ce-a47d-67035c91cfc4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:09.293515 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dc784ee4-c72f-48ce-a47d-67035c91cfc4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:09.294675 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-dc784ee4-c72f-48ce-a47d-67035c91cfc4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.157010 Jun 03 15:29:09.295239 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 170/355] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:09 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:09.372630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Flavor limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:29:09.373057 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Image limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:29:09.373528 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Flavor pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:29:09.373936 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Image pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:29:09.374379 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:29:09.383441 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:09.383883 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:09.384682 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:09.385113 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:09.402208 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Getting quotas for project a402ec1153624838be07cda58279f2a4. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:29:09.406152 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Getting quotas for user 127a6938bc5c4416a9a502d9064344cd and project a402ec1153624838be07cda58279f2a4. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:29:09.418561 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Going to run 1 instances... {{(pid=117806) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:29:09.420861 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:29:09.466370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f949302e-9554-448b-a602-ce2f4d00c6a2 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.580682 Jun 03 15:29:09.467211 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 186/356] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:29:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:29:09.477776 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a54fe331-5513-4ce7-a732-ff017c0ca84c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:09.478386 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a54fe331-5513-4ce7-a732-ff017c0ca84c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:09.537380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a54fe331-5513-4ce7-a732-ff017c0ca84c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:09.545283 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a54fe331-5513-4ce7-a732-ff017c0ca84c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1246 microversion: 2.1 time: 0.071495 Jun 03 15:29:09.546141 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 171/357] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:09 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:09.901733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-75f98091-7a05-448a-aef4-16cb5554457f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:09.902341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-75f98091-7a05-448a-aef4-16cb5554457f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:09.908499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-75f98091-7a05-448a-aef4-16cb5554457f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:09.908947 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-75f98091-7a05-448a-aef4-16cb5554457f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:09.909705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-75f98091-7a05-448a-aef4-16cb5554457f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:09.910173 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-75f98091-7a05-448a-aef4-16cb5554457f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:09.936667 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e9ea6dfe-9d1f-4054-a82c-bc633466ca3f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:09.937270 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e9ea6dfe-9d1f-4054-a82c-bc633466ca3f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:09.945599 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e9ea6dfe-9d1f-4054-a82c-bc633466ca3f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:09.946132 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e9ea6dfe-9d1f-4054-a82c-bc633466ca3f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:09.947022 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e9ea6dfe-9d1f-4054-a82c-bc633466ca3f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:09.947536 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e9ea6dfe-9d1f-4054-a82c-bc633466ca3f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:10.042214 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-75f98091-7a05-448a-aef4-16cb5554457f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:10.050285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-75f98091-7a05-448a-aef4-16cb5554457f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1444 microversion: 2.1 time: 0.152902 Jun 03 15:29:10.050986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 187/358] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:09 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:10.067241 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0863351a-fe0b-42fa-ba05-6c087a466a7c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:10.068262 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0863351a-fe0b-42fa-ba05-6c087a466a7c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:10.075136 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0863351a-fe0b-42fa-ba05-6c087a466a7c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:10.075621 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0863351a-fe0b-42fa-ba05-6c087a466a7c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:10.076406 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0863351a-fe0b-42fa-ba05-6c087a466a7c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:10.076845 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0863351a-fe0b-42fa-ba05-6c087a466a7c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:10.083568 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e9ea6dfe-9d1f-4054-a82c-bc633466ca3f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:10.092337 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e9ea6dfe-9d1f-4054-a82c-bc633466ca3f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.159506 Jun 03 15:29:10.093214 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 172/359] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:09 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:10.155589 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d1604bc1-781a-4215-bce7-ffd7b78bf9db tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:10.156198 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d1604bc1-781a-4215-bce7-ffd7b78bf9db tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:10.162215 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d1604bc1-781a-4215-bce7-ffd7b78bf9db tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:10.162760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d1604bc1-781a-4215-bce7-ffd7b78bf9db tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:10.163651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d1604bc1-781a-4215-bce7-ffd7b78bf9db tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:10.164139 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d1604bc1-781a-4215-bce7-ffd7b78bf9db tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:10.214637 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0863351a-fe0b-42fa-ba05-6c087a466a7c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:10.222218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0863351a-fe0b-42fa-ba05-6c087a466a7c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1444 microversion: 2.1 time: 0.159421 Jun 03 15:29:10.222887 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 188/360] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:10 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:10.309025 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d1604bc1-781a-4215-bce7-ffd7b78bf9db tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:10.312362 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c06cd3a9-e785-4508-8176-b67f69b748f7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:10.312974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c06cd3a9-e785-4508-8176-b67f69b748f7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:10.318007 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d1604bc1-781a-4215-bce7-ffd7b78bf9db tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.166277 Jun 03 15:29:10.320215 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c06cd3a9-e785-4508-8176-b67f69b748f7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:10.320837 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c06cd3a9-e785-4508-8176-b67f69b748f7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:10.321623 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c06cd3a9-e785-4508-8176-b67f69b748f7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:10.322066 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c06cd3a9-e785-4508-8176-b67f69b748f7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:10.327808 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 173/361] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:10 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:10.462282 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c06cd3a9-e785-4508-8176-b67f69b748f7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:10.480166 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c06cd3a9-e785-4508-8176-b67f69b748f7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:10.484546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c06cd3a9-e785-4508-8176-b67f69b748f7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:10.487989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c06cd3a9-e785-4508-8176-b67f69b748f7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.177913 Jun 03 15:29:10.489014 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 189/362] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:10 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:29:10.562748 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ae51e779-1758-4868-904e-33f58b77a24c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:10.563358 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ae51e779-1758-4868-904e-33f58b77a24c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:10.570394 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ae51e779-1758-4868-904e-33f58b77a24c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:10.571112 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ae51e779-1758-4868-904e-33f58b77a24c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:10.571895 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ae51e779-1758-4868-904e-33f58b77a24c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:10.572331 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ae51e779-1758-4868-904e-33f58b77a24c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:10.636683 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ae51e779-1758-4868-904e-33f58b77a24c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:10.645929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ae51e779-1758-4868-904e-33f58b77a24c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1298 microversion: 2.1 time: 0.087235 Jun 03 15:29:10.646881 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 174/363] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:10 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:11.109110 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-26f606a9-734b-4472-a27a-4bd4ab4b2c43 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:11.109941 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-26f606a9-734b-4472-a27a-4bd4ab4b2c43 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:11.117493 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-26f606a9-734b-4472-a27a-4bd4ab4b2c43 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:11.118084 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-26f606a9-734b-4472-a27a-4bd4ab4b2c43 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:11.119132 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-26f606a9-734b-4472-a27a-4bd4ab4b2c43 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:11.119670 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-26f606a9-734b-4472-a27a-4bd4ab4b2c43 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:11.334585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-01cf3e9d-21d0-4ee3-b1b3-527c81b28753 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:11.335200 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-01cf3e9d-21d0-4ee3-b1b3-527c81b28753 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:11.341659 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-01cf3e9d-21d0-4ee3-b1b3-527c81b28753 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:11.342112 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-01cf3e9d-21d0-4ee3-b1b3-527c81b28753 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:11.342913 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-01cf3e9d-21d0-4ee3-b1b3-527c81b28753 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:11.343345 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-01cf3e9d-21d0-4ee3-b1b3-527c81b28753 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:11.492353 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-01cf3e9d-21d0-4ee3-b1b3-527c81b28753 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:11.500792 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-01cf3e9d-21d0-4ee3-b1b3-527c81b28753 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.170153 Jun 03 15:29:11.502254 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 175/364] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:11 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:11.506794 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e79a7fbc-ca3b-4e8b-a037-dd0b69be36cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:11.507601 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e79a7fbc-ca3b-4e8b-a037-dd0b69be36cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:11.515729 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e79a7fbc-ca3b-4e8b-a037-dd0b69be36cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:11.516174 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e79a7fbc-ca3b-4e8b-a037-dd0b69be36cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:11.516955 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e79a7fbc-ca3b-4e8b-a037-dd0b69be36cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:11.517559 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e79a7fbc-ca3b-4e8b-a037-dd0b69be36cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:11.535298 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-26f606a9-734b-4472-a27a-4bd4ab4b2c43 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:11.546835 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-26f606a9-734b-4472-a27a-4bd4ab4b2c43 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.441094 Jun 03 15:29:11.556169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 190/365] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:11 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:11.659871 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e79a7fbc-ca3b-4e8b-a037-dd0b69be36cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:11.664140 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3d097a2b-7273-4326-85cd-33ba73ff01f9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:11.664749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3d097a2b-7273-4326-85cd-33ba73ff01f9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:11.668345 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e79a7fbc-ca3b-4e8b-a037-dd0b69be36cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:11.669853 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e79a7fbc-ca3b-4e8b-a037-dd0b69be36cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:11.671124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3d097a2b-7273-4326-85cd-33ba73ff01f9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:11.671279 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e79a7fbc-ca3b-4e8b-a037-dd0b69be36cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1744 microversion: 2.20 time: 0.168555 Jun 03 15:29:11.671850 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3d097a2b-7273-4326-85cd-33ba73ff01f9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:11.671988 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 176/366] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:11 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:11.683891 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3d097a2b-7273-4326-85cd-33ba73ff01f9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:11.684351 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3d097a2b-7273-4326-85cd-33ba73ff01f9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:11.785149 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3d097a2b-7273-4326-85cd-33ba73ff01f9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:11.787704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:11.794250 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3d097a2b-7273-4326-85cd-33ba73ff01f9 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1304 microversion: 2.1 time: 0.134080 Jun 03 15:29:11.794857 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 191/367] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:11 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:12.517475 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6a3a4a2b-1bfd-4551-874b-6c1f1fb31af4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:12.518084 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6a3a4a2b-1bfd-4551-874b-6c1f1fb31af4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:12.525056 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6a3a4a2b-1bfd-4551-874b-6c1f1fb31af4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:12.525507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6a3a4a2b-1bfd-4551-874b-6c1f1fb31af4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:12.526278 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6a3a4a2b-1bfd-4551-874b-6c1f1fb31af4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:12.526923 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6a3a4a2b-1bfd-4551-874b-6c1f1fb31af4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:12.563033 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ece4631d-7167-4632-a1e6-f2c305f76c9c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:12.563642 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ece4631d-7167-4632-a1e6-f2c305f76c9c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:12.571799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ece4631d-7167-4632-a1e6-f2c305f76c9c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:12.572252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ece4631d-7167-4632-a1e6-f2c305f76c9c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:12.573034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ece4631d-7167-4632-a1e6-f2c305f76c9c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:12.573535 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ece4631d-7167-4632-a1e6-f2c305f76c9c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:12.679165 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6a3a4a2b-1bfd-4551-874b-6c1f1fb31af4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:12.689393 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6a3a4a2b-1bfd-4551-874b-6c1f1fb31af4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.175641 Jun 03 15:29:12.690292 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 177/368] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:12 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:12.695196 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f538931a-0d69-40c4-b588-9e9f8c01b83d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:12.695794 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f538931a-0d69-40c4-b588-9e9f8c01b83d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:12.706638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f538931a-0d69-40c4-b588-9e9f8c01b83d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:12.707091 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f538931a-0d69-40c4-b588-9e9f8c01b83d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:12.707876 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f538931a-0d69-40c4-b588-9e9f8c01b83d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:12.708429 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f538931a-0d69-40c4-b588-9e9f8c01b83d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:12.890355 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ece4631d-7167-4632-a1e6-f2c305f76c9c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:12.895934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f538931a-0d69-40c4-b588-9e9f8c01b83d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:12.905523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ece4631d-7167-4632-a1e6-f2c305f76c9c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.346125 Jun 03 15:29:12.906036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 192/369] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:12 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:12.906166 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f538931a-0d69-40c4-b588-9e9f8c01b83d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:12.909030 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f538931a-0d69-40c4-b588-9e9f8c01b83d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:12.911990 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f538931a-0d69-40c4-b588-9e9f8c01b83d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1744 microversion: 2.20 time: 0.220482 Jun 03 15:29:12.913480 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 178/370] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:12 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:12.914562 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-968ffd2f-a3cc-4ec0-9cf9-d7b301dcef8f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:12.914933 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-968ffd2f-a3cc-4ec0-9cf9-d7b301dcef8f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:12.931098 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-968ffd2f-a3cc-4ec0-9cf9-d7b301dcef8f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:12.931555 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-968ffd2f-a3cc-4ec0-9cf9-d7b301dcef8f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:12.932411 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-968ffd2f-a3cc-4ec0-9cf9-d7b301dcef8f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:12.932856 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-968ffd2f-a3cc-4ec0-9cf9-d7b301dcef8f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:13.160025 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-3b4ea9f2-1fff-4c4c-9f34-74d1c783c463 req-eb48660b-61b3-414b-8d25-b8966c462cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2", "name": "network-vif-plugged", "status": "completed", "tag": "343d88d0-4f0d-4021-bfee-efee56348782"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:13.169718 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-3b4ea9f2-1fff-4c4c-9f34-74d1c783c463 req-eb48660b-61b3-414b-8d25-b8966c462cec service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:13.170354 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-3b4ea9f2-1fff-4c4c-9f34-74d1c783c463 req-eb48660b-61b3-414b-8d25-b8966c462cec service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:13.185336 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-3b4ea9f2-1fff-4c4c-9f34-74d1c783c463 req-eb48660b-61b3-414b-8d25-b8966c462cec service nova] Creating event network-vif-plugged:343d88d0-4f0d-4021-bfee-efee56348782 for instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 on hv-cinder-83124 Jun 03 15:29:13.193525 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-3b4ea9f2-1fff-4c4c-9f34-74d1c783c463 req-eb48660b-61b3-414b-8d25-b8966c462cec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034888 Jun 03 15:29:13.193525 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 179/371] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:29:13.508729 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-968ffd2f-a3cc-4ec0-9cf9-d7b301dcef8f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:13.516322 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-968ffd2f-a3cc-4ec0-9cf9-d7b301dcef8f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1372 microversion: 2.1 time: 0.608920 Jun 03 15:29:13.516890 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 193/372] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:12 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1372 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:13.681354 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-1c817885-81da-4b18-bb52-7daf519d28e0 req-d409921a-df91-47ba-82f2-ae78cd408de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800d0eab-3550-4b55-8837-765681285f77", "tag": "5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:13.697943 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-1c817885-81da-4b18-bb52-7daf519d28e0 req-d409921a-df91-47ba-82f2-ae78cd408de9 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:13.698508 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-1c817885-81da-4b18-bb52-7daf519d28e0 req-d409921a-df91-47ba-82f2-ae78cd408de9 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:13.706483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4a7ead51-f477-48e7-8b5b-bc6d0d379dd9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:13.707199 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4a7ead51-f477-48e7-8b5b-bc6d0d379dd9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:13.715148 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4a7ead51-f477-48e7-8b5b-bc6d0d379dd9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:13.716241 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4a7ead51-f477-48e7-8b5b-bc6d0d379dd9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:13.717644 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4a7ead51-f477-48e7-8b5b-bc6d0d379dd9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:13.718252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4a7ead51-f477-48e7-8b5b-bc6d0d379dd9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:13.720173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-1c817885-81da-4b18-bb52-7daf519d28e0 req-d409921a-df91-47ba-82f2-ae78cd408de9 service nova] Creating event network-changed:5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533 for instance 800d0eab-3550-4b55-8837-765681285f77 on hv-cinder-83124 Jun 03 15:29:13.726943 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-1c817885-81da-4b18-bb52-7daf519d28e0 req-d409921a-df91-47ba-82f2-ae78cd408de9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053401 Jun 03 15:29:13.728484 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 180/373] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:29:13.924126 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4b144fdb-48c1-45a0-a665-4458e51fee68 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:13.925436 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4b144fdb-48c1-45a0-a665-4458e51fee68 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:13.944652 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b144fdb-48c1-45a0-a665-4458e51fee68 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:13.945530 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b144fdb-48c1-45a0-a665-4458e51fee68 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:13.946816 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b144fdb-48c1-45a0-a665-4458e51fee68 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:13.947693 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b144fdb-48c1-45a0-a665-4458e51fee68 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:13.993481 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4a7ead51-f477-48e7-8b5b-bc6d0d379dd9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:14.006757 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4a7ead51-f477-48e7-8b5b-bc6d0d379dd9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.303919 Jun 03 15:29:14.019540 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 194/374] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:13 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:14.019540 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f5b5774f-b395-41f8-ab2d-4b11d3d11ba5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:14.019540 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f5b5774f-b395-41f8-ab2d-4b11d3d11ba5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:14.036669 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5b5774f-b395-41f8-ab2d-4b11d3d11ba5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:14.037161 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5b5774f-b395-41f8-ab2d-4b11d3d11ba5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:14.043022 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5b5774f-b395-41f8-ab2d-4b11d3d11ba5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:14.043553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5b5774f-b395-41f8-ab2d-4b11d3d11ba5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:14.206645 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4b144fdb-48c1-45a0-a665-4458e51fee68 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:14.214931 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4b144fdb-48c1-45a0-a665-4458e51fee68 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.295465 Jun 03 15:29:14.215511 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 181/375] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:13 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:14.263678 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f5b5774f-b395-41f8-ab2d-4b11d3d11ba5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:14.277510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f5b5774f-b395-41f8-ab2d-4b11d3d11ba5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:14.280083 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f5b5774f-b395-41f8-ab2d-4b11d3d11ba5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:14.281984 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f5b5774f-b395-41f8-ab2d-4b11d3d11ba5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1744 microversion: 2.20 time: 0.270911 Jun 03 15:29:14.283102 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 195/376] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:14 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1744 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:14.533284 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9d323036-868c-4f9c-a17f-5e12937dcff0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:14.533964 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9d323036-868c-4f9c-a17f-5e12937dcff0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:14.540901 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9d323036-868c-4f9c-a17f-5e12937dcff0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:14.541448 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9d323036-868c-4f9c-a17f-5e12937dcff0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:14.542293 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9d323036-868c-4f9c-a17f-5e12937dcff0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:14.542817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9d323036-868c-4f9c-a17f-5e12937dcff0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:14.680840 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9d323036-868c-4f9c-a17f-5e12937dcff0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:14.688462 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9d323036-868c-4f9c-a17f-5e12937dcff0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1372 microversion: 2.1 time: 0.159068 Jun 03 15:29:14.689055 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 182/377] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:14 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:15.027793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a4ec0806-d1ed-4e82-be32-8c3eb73d4f89 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:15.028459 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a4ec0806-d1ed-4e82-be32-8c3eb73d4f89 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:15.035207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a4ec0806-d1ed-4e82-be32-8c3eb73d4f89 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:15.035657 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a4ec0806-d1ed-4e82-be32-8c3eb73d4f89 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:15.036597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a4ec0806-d1ed-4e82-be32-8c3eb73d4f89 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:15.037029 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a4ec0806-d1ed-4e82-be32-8c3eb73d4f89 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:15.207036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a4ec0806-d1ed-4e82-be32-8c3eb73d4f89 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:15.214397 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a4ec0806-d1ed-4e82-be32-8c3eb73d4f89 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1366 microversion: 2.1 time: 0.191324 Jun 03 15:29:15.214980 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 196/378] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:15 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:15.217593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-e2e472b5-9c24-4877-87cd-4e7c4f44dad6 req-60cde7ff-b0c2-4175-b9b9-a1e95659b6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123dc0c-78c6-44ce-b847-927843a3751c", "name": "network-vif-plugged", "status": "completed", "tag": "d065a51d-4c7e-482f-87f7-74c4d679a6c1"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:15.226510 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-e2e472b5-9c24-4877-87cd-4e7c4f44dad6 req-60cde7ff-b0c2-4175-b9b9-a1e95659b6fe service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:15.226976 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-e2e472b5-9c24-4877-87cd-4e7c4f44dad6 req-60cde7ff-b0c2-4175-b9b9-a1e95659b6fe service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:15.232359 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-37630e75-5a40-4a18-8727-89af4bd78a1a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:15.232955 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-37630e75-5a40-4a18-8727-89af4bd78a1a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:15.238143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-e2e472b5-9c24-4877-87cd-4e7c4f44dad6 req-60cde7ff-b0c2-4175-b9b9-a1e95659b6fe service nova] Creating event network-vif-plugged:d065a51d-4c7e-482f-87f7-74c4d679a6c1 for instance e123dc0c-78c6-44ce-b847-927843a3751c on hv-cinder-83124 Jun 03 15:29:15.239330 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-37630e75-5a40-4a18-8727-89af4bd78a1a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:15.239869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-37630e75-5a40-4a18-8727-89af4bd78a1a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:15.240631 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-37630e75-5a40-4a18-8727-89af4bd78a1a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:15.241064 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-37630e75-5a40-4a18-8727-89af4bd78a1a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:15.243363 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-e2e472b5-9c24-4877-87cd-4e7c4f44dad6 req-60cde7ff-b0c2-4175-b9b9-a1e95659b6fe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029494 Jun 03 15:29:15.243954 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 183/379] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:29:15.301506 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0d761557-7e6d-4c89-8eeb-4a8d1a4b3787 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:15.302339 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0d761557-7e6d-4c89-8eeb-4a8d1a4b3787 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:15.308617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0d761557-7e6d-4c89-8eeb-4a8d1a4b3787 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:15.309058 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0d761557-7e6d-4c89-8eeb-4a8d1a4b3787 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:15.309821 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0d761557-7e6d-4c89-8eeb-4a8d1a4b3787 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:15.310254 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0d761557-7e6d-4c89-8eeb-4a8d1a4b3787 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:15.374733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-37630e75-5a40-4a18-8727-89af4bd78a1a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:15.384381 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-37630e75-5a40-4a18-8727-89af4bd78a1a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.155583 Jun 03 15:29:15.385240 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 197/380] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:15 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:15.450426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0d761557-7e6d-4c89-8eeb-4a8d1a4b3787 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:15.461822 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0d761557-7e6d-4c89-8eeb-4a8d1a4b3787 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:15.463778 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0d761557-7e6d-4c89-8eeb-4a8d1a4b3787 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:15.465090 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0d761557-7e6d-4c89-8eeb-4a8d1a4b3787 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1739 microversion: 2.20 time: 0.168400 Jun 03 15:29:15.467064 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 184/381] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:15 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:29:15.705705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c52282eb-a7dc-47d4-addb-386fb002f445 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:15.706319 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c52282eb-a7dc-47d4-addb-386fb002f445 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:15.712502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c52282eb-a7dc-47d4-addb-386fb002f445 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:15.712960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c52282eb-a7dc-47d4-addb-386fb002f445 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:15.713726 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c52282eb-a7dc-47d4-addb-386fb002f445 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:15.714163 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c52282eb-a7dc-47d4-addb-386fb002f445 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:15.746937 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-6c1b900f-56a8-4049-a18e-6765f88e65ed req-de4fa39f-cb4f-4a08-885d-ff7d9095e242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99322d93-058a-4216-a672-e7f482aab8d8", "tag": "3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:15.755488 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-6c1b900f-56a8-4049-a18e-6765f88e65ed req-de4fa39f-cb4f-4a08-885d-ff7d9095e242 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:15.756012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-6c1b900f-56a8-4049-a18e-6765f88e65ed req-de4fa39f-cb4f-4a08-885d-ff7d9095e242 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:15.760093 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=100 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:15.768001 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-6c1b900f-56a8-4049-a18e-6765f88e65ed req-de4fa39f-cb4f-4a08-885d-ff7d9095e242 service nova] Creating event network-changed:3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee for instance 99322d93-058a-4216-a672-e7f482aab8d8 on hv-cinder-83124 Jun 03 15:29:15.772885 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-6c1b900f-56a8-4049-a18e-6765f88e65ed req-de4fa39f-cb4f-4a08-885d-ff7d9095e242 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029612 Jun 03 15:29:15.773465 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 185/382] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:29:15.846650 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c52282eb-a7dc-47d4-addb-386fb002f445 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:15.854042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c52282eb-a7dc-47d4-addb-386fb002f445 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1372 microversion: 2.1 time: 0.152264 Jun 03 15:29:15.854622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 198/383] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:15 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:16.232778 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a2a608c0-9587-4e58-9415-a8b612fcd5de tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:16.233472 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a2a608c0-9587-4e58-9415-a8b612fcd5de tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:16.241969 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2a608c0-9587-4e58-9415-a8b612fcd5de tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:16.242420 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2a608c0-9587-4e58-9415-a8b612fcd5de tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:16.243211 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2a608c0-9587-4e58-9415-a8b612fcd5de tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:16.243807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2a608c0-9587-4e58-9415-a8b612fcd5de tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:16.380717 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a2a608c0-9587-4e58-9415-a8b612fcd5de tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:16.388535 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a2a608c0-9587-4e58-9415-a8b612fcd5de tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1557 microversion: 2.1 time: 0.160781 Jun 03 15:29:16.389319 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 186/384] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:16 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:16.404593 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-39e3e27f-d809-4b6d-a81c-3da8e049939d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:16.405262 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-39e3e27f-d809-4b6d-a81c-3da8e049939d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:16.405585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3fb5f842-07fc-4125-ad34-5829c21c5df9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:16.406072 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3fb5f842-07fc-4125-ad34-5829c21c5df9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:16.412200 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-39e3e27f-d809-4b6d-a81c-3da8e049939d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:16.413173 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-39e3e27f-d809-4b6d-a81c-3da8e049939d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:16.413291 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3fb5f842-07fc-4125-ad34-5829c21c5df9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:16.413626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3fb5f842-07fc-4125-ad34-5829c21c5df9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:16.414214 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-39e3e27f-d809-4b6d-a81c-3da8e049939d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:16.414394 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3fb5f842-07fc-4125-ad34-5829c21c5df9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:16.414849 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-39e3e27f-d809-4b6d-a81c-3da8e049939d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:16.415019 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3fb5f842-07fc-4125-ad34-5829c21c5df9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:16.503669 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3fb5f842-07fc-4125-ad34-5829c21c5df9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101779 Jun 03 15:29:16.504991 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 187/385] 10.222.0.93 () {58 vars in 1274 bytes} [Fri Jun 3 15:29:16 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:29:16.512054 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f6f4a5d8-6004-459b-a161-0bea21596cee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:16.513057 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f6f4a5d8-6004-459b-a161-0bea21596cee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:16.521936 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f6f4a5d8-6004-459b-a161-0bea21596cee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:16.523089 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f6f4a5d8-6004-459b-a161-0bea21596cee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:16.524130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f6f4a5d8-6004-459b-a161-0bea21596cee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:16.524927 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f6f4a5d8-6004-459b-a161-0bea21596cee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:16.562404 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-39e3e27f-d809-4b6d-a81c-3da8e049939d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:16.572119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-39e3e27f-d809-4b6d-a81c-3da8e049939d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.173519 Jun 03 15:29:16.573710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 199/386] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:16 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:16.872870 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f6f4a5d8-6004-459b-a161-0bea21596cee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:16.879354 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-96090848-4f9a-4afc-b20d-a13a4db2f14e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:16.880285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-96090848-4f9a-4afc-b20d-a13a4db2f14e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:16.898399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f6f4a5d8-6004-459b-a161-0bea21596cee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:16.899747 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-96090848-4f9a-4afc-b20d-a13a4db2f14e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:16.900442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-96090848-4f9a-4afc-b20d-a13a4db2f14e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:16.902278 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f6f4a5d8-6004-459b-a161-0bea21596cee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:16.903297 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-96090848-4f9a-4afc-b20d-a13a4db2f14e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:16.903971 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-96090848-4f9a-4afc-b20d-a13a4db2f14e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:16.906394 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f6f4a5d8-6004-459b-a161-0bea21596cee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1739 microversion: 2.20 time: 0.399692 Jun 03 15:29:16.911143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 188/387] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:16 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:17.086220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-96090848-4f9a-4afc-b20d-a13a4db2f14e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:17.094935 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-96090848-4f9a-4afc-b20d-a13a4db2f14e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1372 microversion: 2.1 time: 0.226983 Jun 03 15:29:17.097030 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 200/388] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:16 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:17.591797 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0c2d2289-c56b-45c6-9763-3e97accd08fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:17.592734 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0c2d2289-c56b-45c6-9763-3e97accd08fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:17.603947 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0c2d2289-c56b-45c6-9763-3e97accd08fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:17.604741 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0c2d2289-c56b-45c6-9763-3e97accd08fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:17.605779 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0c2d2289-c56b-45c6-9763-3e97accd08fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:17.606803 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0c2d2289-c56b-45c6-9763-3e97accd08fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:17.931139 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3dd49cc7-4273-43d5-b3eb-54dfc22547c6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:17.932342 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3dd49cc7-4273-43d5-b3eb-54dfc22547c6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:17.950937 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0c2d2289-c56b-45c6-9763-3e97accd08fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:17.959616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3dd49cc7-4273-43d5-b3eb-54dfc22547c6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:17.960280 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3dd49cc7-4273-43d5-b3eb-54dfc22547c6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:17.961211 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3dd49cc7-4273-43d5-b3eb-54dfc22547c6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:17.961855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3dd49cc7-4273-43d5-b3eb-54dfc22547c6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:17.962926 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0c2d2289-c56b-45c6-9763-3e97accd08fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.375570 Jun 03 15:29:17.971603 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 189/389] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:17 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:18.117360 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-84472433-6393-45d9-823f-e0bd540d582b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:18.117986 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-84472433-6393-45d9-823f-e0bd540d582b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:18.147400 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-84472433-6393-45d9-823f-e0bd540d582b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:18.147910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-84472433-6393-45d9-823f-e0bd540d582b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:18.148692 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-84472433-6393-45d9-823f-e0bd540d582b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:18.149123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-84472433-6393-45d9-823f-e0bd540d582b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:18.244221 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3dd49cc7-4273-43d5-b3eb-54dfc22547c6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:18.255603 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3dd49cc7-4273-43d5-b3eb-54dfc22547c6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:18.257110 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3dd49cc7-4273-43d5-b3eb-54dfc22547c6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:18.258310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3dd49cc7-4273-43d5-b3eb-54dfc22547c6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1739 microversion: 2.20 time: 0.333343 Jun 03 15:29:18.264215 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 201/390] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:17 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:18.268887 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-f88e011a-8a5f-45d2-a2c9-58201989431b req-0d99cdea-f65b-4dce-82d2-cd8710843c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2", "tag": "343d88d0-4f0d-4021-bfee-efee56348782"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:18.281338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-f88e011a-8a5f-45d2-a2c9-58201989431b req-0d99cdea-f65b-4dce-82d2-cd8710843c8f service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:18.281780 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-f88e011a-8a5f-45d2-a2c9-58201989431b req-0d99cdea-f65b-4dce-82d2-cd8710843c8f service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:18.300011 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-f88e011a-8a5f-45d2-a2c9-58201989431b req-0d99cdea-f65b-4dce-82d2-cd8710843c8f service nova] Creating event network-changed:343d88d0-4f0d-4021-bfee-efee56348782 for instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 on hv-cinder-83124 Jun 03 15:29:18.306084 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-f88e011a-8a5f-45d2-a2c9-58201989431b req-0d99cdea-f65b-4dce-82d2-cd8710843c8f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040124 Jun 03 15:29:18.306711 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 202/391] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:29:18.447004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-84472433-6393-45d9-823f-e0bd540d582b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:18.460966 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-84472433-6393-45d9-823f-e0bd540d582b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1372 microversion: 2.1 time: 0.345394 Jun 03 15:29:18.460966 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 190/392] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:18 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1372 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:18.990488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2ed356a0-b16c-465e-84ab-c46e3c74693a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:18.992630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2ed356a0-b16c-465e-84ab-c46e3c74693a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:19.005752 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2ed356a0-b16c-465e-84ab-c46e3c74693a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:19.006513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2ed356a0-b16c-465e-84ab-c46e3c74693a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:19.007422 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2ed356a0-b16c-465e-84ab-c46e3c74693a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:19.008070 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2ed356a0-b16c-465e-84ab-c46e3c74693a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:19.189778 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2ed356a0-b16c-465e-84ab-c46e3c74693a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:19.201350 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2ed356a0-b16c-465e-84ab-c46e3c74693a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.216265 Jun 03 15:29:19.213628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 203/393] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:18 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:19.280878 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b8ecdc4a-f12e-4a57-8781-66a96d7a9d51 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:19.284948 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b8ecdc4a-f12e-4a57-8781-66a96d7a9d51 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:19.292940 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b8ecdc4a-f12e-4a57-8781-66a96d7a9d51 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:19.293383 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b8ecdc4a-f12e-4a57-8781-66a96d7a9d51 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:19.294151 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b8ecdc4a-f12e-4a57-8781-66a96d7a9d51 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:19.294721 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b8ecdc4a-f12e-4a57-8781-66a96d7a9d51 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:19.464260 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b8ecdc4a-f12e-4a57-8781-66a96d7a9d51 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:19.473089 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-cd2e7a8e-5825-4a71-9191-9b1dae33a733 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:19.473977 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-cd2e7a8e-5825-4a71-9191-9b1dae33a733 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:19.486976 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:19.492708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=6 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:19.494814 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:19.497189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cd2e7a8e-5825-4a71-9191-9b1dae33a733 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:19.500618 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b8ecdc4a-f12e-4a57-8781-66a96d7a9d51 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:19.500972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cd2e7a8e-5825-4a71-9191-9b1dae33a733 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:19.503064 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b8ecdc4a-f12e-4a57-8781-66a96d7a9d51 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:19.504541 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b8ecdc4a-f12e-4a57-8781-66a96d7a9d51 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1739 microversion: 2.20 time: 0.232013 Jun 03 15:29:19.514566 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cd2e7a8e-5825-4a71-9191-9b1dae33a733 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:19.514566 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cd2e7a8e-5825-4a71-9191-9b1dae33a733 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:19.516017 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 191/394] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:19 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:19.689117 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-cd2e7a8e-5825-4a71-9191-9b1dae33a733 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:19.705556 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-cd2e7a8e-5825-4a71-9191-9b1dae33a733 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1372 microversion: 2.1 time: 0.236067 Jun 03 15:29:19.706702 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 204/395] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:19 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:20.217234 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=24 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:20.222901 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0a98c5da-0973-4a0a-a0e4-58fa21b3dfc6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:20.223755 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0a98c5da-0973-4a0a-a0e4-58fa21b3dfc6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:20.225593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:20.231722 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0a98c5da-0973-4a0a-a0e4-58fa21b3dfc6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:20.232175 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0a98c5da-0973-4a0a-a0e4-58fa21b3dfc6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:20.234576 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0a98c5da-0973-4a0a-a0e4-58fa21b3dfc6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:20.234576 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0a98c5da-0973-4a0a-a0e4-58fa21b3dfc6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:20.395192 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0a98c5da-0973-4a0a-a0e4-58fa21b3dfc6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:20.404321 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0a98c5da-0973-4a0a-a0e4-58fa21b3dfc6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.187938 Jun 03 15:29:20.405719 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 192/396] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:20 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:20.526137 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-288f0438-86a9-4c6c-840f-092785183cb1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:20.527826 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-288f0438-86a9-4c6c-840f-092785183cb1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:20.536844 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-288f0438-86a9-4c6c-840f-092785183cb1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:20.537820 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-288f0438-86a9-4c6c-840f-092785183cb1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:20.539874 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-288f0438-86a9-4c6c-840f-092785183cb1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:20.540514 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-288f0438-86a9-4c6c-840f-092785183cb1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:20.703464 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-288f0438-86a9-4c6c-840f-092785183cb1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:20.718338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-288f0438-86a9-4c6c-840f-092785183cb1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:20.725450 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-54443cf2-222a-4271-b39d-fa89e3f5e265 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:20.726207 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-54443cf2-222a-4271-b39d-fa89e3f5e265 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:20.729767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-288f0438-86a9-4c6c-840f-092785183cb1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:20.734522 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-288f0438-86a9-4c6c-840f-092785183cb1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1739 microversion: 2.20 time: 0.213623 Jun 03 15:29:20.738436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 205/397] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:20 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:20.738942 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-54443cf2-222a-4271-b39d-fa89e3f5e265 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:20.739750 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-54443cf2-222a-4271-b39d-fa89e3f5e265 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:20.741726 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-54443cf2-222a-4271-b39d-fa89e3f5e265 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:20.742456 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-54443cf2-222a-4271-b39d-fa89e3f5e265 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:20.913958 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-54443cf2-222a-4271-b39d-fa89e3f5e265 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:20.924875 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-54443cf2-222a-4271-b39d-fa89e3f5e265 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1372 microversion: 2.1 time: 0.203281 Jun 03 15:29:20.926070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 193/398] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:20 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:21.423241 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2a5f2a03-e5e4-41af-a695-a7494e7a1c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:21.423984 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2a5f2a03-e5e4-41af-a695-a7494e7a1c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:21.433622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a5f2a03-e5e4-41af-a695-a7494e7a1c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:21.434257 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a5f2a03-e5e4-41af-a695-a7494e7a1c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:21.435274 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a5f2a03-e5e4-41af-a695-a7494e7a1c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:21.435656 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a5f2a03-e5e4-41af-a695-a7494e7a1c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:21.594504 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2a5f2a03-e5e4-41af-a695-a7494e7a1c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:21.604542 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2a5f2a03-e5e4-41af-a695-a7494e7a1c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.185323 Jun 03 15:29:21.605182 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 206/399] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:21 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:21.755688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-faa081b3-b325-4604-9733-85a004f12dad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:21.756287 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-faa081b3-b325-4604-9733-85a004f12dad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:21.766011 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-faa081b3-b325-4604-9733-85a004f12dad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:21.766485 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-faa081b3-b325-4604-9733-85a004f12dad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:21.767984 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-faa081b3-b325-4604-9733-85a004f12dad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:21.768597 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-faa081b3-b325-4604-9733-85a004f12dad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:21.917736 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-faa081b3-b325-4604-9733-85a004f12dad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:21.931160 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-faa081b3-b325-4604-9733-85a004f12dad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:21.932946 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-faa081b3-b325-4604-9733-85a004f12dad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:21.934222 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-faa081b3-b325-4604-9733-85a004f12dad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1739 microversion: 2.20 time: 0.182906 Jun 03 15:29:21.934808 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 194/400] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:21 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:21.948831 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-63f71e6c-3e45-42e8-bf43-21120ba0edb8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:21.949942 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-63f71e6c-3e45-42e8-bf43-21120ba0edb8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:21.956637 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63f71e6c-3e45-42e8-bf43-21120ba0edb8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:21.957158 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63f71e6c-3e45-42e8-bf43-21120ba0edb8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:21.957946 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63f71e6c-3e45-42e8-bf43-21120ba0edb8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:21.960679 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63f71e6c-3e45-42e8-bf43-21120ba0edb8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:22.094892 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-63f71e6c-3e45-42e8-bf43-21120ba0edb8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:22.105523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-63f71e6c-3e45-42e8-bf43-21120ba0edb8 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1372 microversion: 2.1 time: 0.163171 Jun 03 15:29:22.114824 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 207/401] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:21 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:22.621822 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-01bc1923-2e05-4d64-b6da-02c5ffcd5de9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:22.622447 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-01bc1923-2e05-4d64-b6da-02c5ffcd5de9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:22.629483 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-01bc1923-2e05-4d64-b6da-02c5ffcd5de9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:22.629938 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-01bc1923-2e05-4d64-b6da-02c5ffcd5de9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:22.630770 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-01bc1923-2e05-4d64-b6da-02c5ffcd5de9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:22.631243 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-01bc1923-2e05-4d64-b6da-02c5ffcd5de9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:22.779752 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-01bc1923-2e05-4d64-b6da-02c5ffcd5de9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:22.788129 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-01bc1923-2e05-4d64-b6da-02c5ffcd5de9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1722 microversion: 2.1 time: 0.170050 Jun 03 15:29:22.789338 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 195/402] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:22 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:22.952696 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-eb2b46e8-2204-4f5d-80ab-f765ab051135 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:22.953572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-eb2b46e8-2204-4f5d-80ab-f765ab051135 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:22.960983 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-eb2b46e8-2204-4f5d-80ab-f765ab051135 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:22.961743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-eb2b46e8-2204-4f5d-80ab-f765ab051135 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:22.962580 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-eb2b46e8-2204-4f5d-80ab-f765ab051135 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:22.963020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-eb2b46e8-2204-4f5d-80ab-f765ab051135 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:22.965419 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-22ae4c0c-3c8a-4d8e-a555-21b457d6cfcd req-50692530-a738-4f6f-9823-4f6df9704450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99322d93-058a-4216-a672-e7f482aab8d8", "name": "network-vif-plugged", "status": "completed", "tag": "3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:22.975947 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-22ae4c0c-3c8a-4d8e-a555-21b457d6cfcd req-50692530-a738-4f6f-9823-4f6df9704450 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:22.976381 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-22ae4c0c-3c8a-4d8e-a555-21b457d6cfcd req-50692530-a738-4f6f-9823-4f6df9704450 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:22.989903 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-22ae4c0c-3c8a-4d8e-a555-21b457d6cfcd req-50692530-a738-4f6f-9823-4f6df9704450 service nova] Creating event network-vif-plugged:3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee for instance 99322d93-058a-4216-a672-e7f482aab8d8 on hv-cinder-83124 Jun 03 15:29:22.996176 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-22ae4c0c-3c8a-4d8e-a555-21b457d6cfcd req-50692530-a738-4f6f-9823-4f6df9704450 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034237 Jun 03 15:29:22.997572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 196/403] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:29:23.125896 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-285a9259-bf58-4fd4-b7fd-4db946083575 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:23.126995 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-285a9259-bf58-4fd4-b7fd-4db946083575 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:23.147911 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-285a9259-bf58-4fd4-b7fd-4db946083575 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:23.148354 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-285a9259-bf58-4fd4-b7fd-4db946083575 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:23.149177 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-285a9259-bf58-4fd4-b7fd-4db946083575 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:23.149934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-285a9259-bf58-4fd4-b7fd-4db946083575 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:23.175557 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-eb2b46e8-2204-4f5d-80ab-f765ab051135 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:23.189866 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-eb2b46e8-2204-4f5d-80ab-f765ab051135 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:23.191734 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-eb2b46e8-2204-4f5d-80ab-f765ab051135 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:23.194926 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-eb2b46e8-2204-4f5d-80ab-f765ab051135 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1739 microversion: 2.20 time: 0.246094 Jun 03 15:29:23.209974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 208/404] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:22 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:23.375771 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-285a9259-bf58-4fd4-b7fd-4db946083575 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:23.384073 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-285a9259-bf58-4fd4-b7fd-4db946083575 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1372 microversion: 2.1 time: 0.264786 Jun 03 15:29:23.384785 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 197/405] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:23 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:23.807388 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b1b6ef93-15b8-48e1-a179-eab1c308fce9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:23.807388 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b1b6ef93-15b8-48e1-a179-eab1c308fce9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:23.813044 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b1b6ef93-15b8-48e1-a179-eab1c308fce9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:23.813514 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b1b6ef93-15b8-48e1-a179-eab1c308fce9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:23.814957 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b1b6ef93-15b8-48e1-a179-eab1c308fce9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:23.815438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b1b6ef93-15b8-48e1-a179-eab1c308fce9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:23.818154 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=100 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:23.969527 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b1b6ef93-15b8-48e1-a179-eab1c308fce9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:23.978206 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b1b6ef93-15b8-48e1-a179-eab1c308fce9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1699 microversion: 2.1 time: 0.176863 Jun 03 15:29:23.978823 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 209/406] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:23 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1699 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:23.998149 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8ea35c20-a3ce-4a9f-867b-c948d6465090 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:24.007984 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8ea35c20-a3ce-4a9f-867b-c948d6465090 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:24.008524 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8ea35c20-a3ce-4a9f-867b-c948d6465090 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:24.081088 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8ea35c20-a3ce-4a9f-867b-c948d6465090 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Going to try to start instance {{(pid=117805) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 15:29:24.128885 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8ea35c20-a3ce-4a9f-867b-c948d6465090 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/action" status: 202 len: 0 microversion: 2.1 time: 0.134350 Jun 03 15:29:24.129688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 198/407] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:29:23 2022] POST /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:29:24.138212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e05e0573-2e1e-4a4a-a154-53d04b07d720 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:24.138843 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e05e0573-2e1e-4a4a-a154-53d04b07d720 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:24.148720 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e05e0573-2e1e-4a4a-a154-53d04b07d720 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:24.149558 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e05e0573-2e1e-4a4a-a154-53d04b07d720 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:24.150376 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e05e0573-2e1e-4a4a-a154-53d04b07d720 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:24.151029 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e05e0573-2e1e-4a4a-a154-53d04b07d720 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:24.214317 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-df16a63d-b494-47fb-9157-d259358d2339 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:24.215247 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-df16a63d-b494-47fb-9157-d259358d2339 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:24.221971 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df16a63d-b494-47fb-9157-d259358d2339 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:24.222465 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df16a63d-b494-47fb-9157-d259358d2339 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:24.223439 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df16a63d-b494-47fb-9157-d259358d2339 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:24.223994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df16a63d-b494-47fb-9157-d259358d2339 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:24.301176 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e05e0573-2e1e-4a4a-a154-53d04b07d720 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:24.309909 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e05e0573-2e1e-4a4a-a154-53d04b07d720 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1708 microversion: 2.1 time: 0.175856 Jun 03 15:29:24.324972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 210/408] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:24 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1708 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:24.385195 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-df16a63d-b494-47fb-9157-d259358d2339 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:24.396651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-df16a63d-b494-47fb-9157-d259358d2339 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:24.398302 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-df16a63d-b494-47fb-9157-d259358d2339 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:24.399650 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-df16a63d-b494-47fb-9157-d259358d2339 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1739 microversion: 2.20 time: 0.189696 Jun 03 15:29:24.400682 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 199/409] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:24 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:24.415387 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-21d6a201-c28f-4a07-96c8-b7518f397b30 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:24.416297 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-21d6a201-c28f-4a07-96c8-b7518f397b30 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:24.422638 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-21d6a201-c28f-4a07-96c8-b7518f397b30 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:24.423093 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-21d6a201-c28f-4a07-96c8-b7518f397b30 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:24.424790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-21d6a201-c28f-4a07-96c8-b7518f397b30 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:24.425400 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-21d6a201-c28f-4a07-96c8-b7518f397b30 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:24.590947 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-21d6a201-c28f-4a07-96c8-b7518f397b30 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:24.600233 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-21d6a201-c28f-4a07-96c8-b7518f397b30 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1372 microversion: 2.1 time: 0.202414 Jun 03 15:29:24.613037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 211/410] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:24 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:25.335866 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6694d40a-e544-4312-9e07-00d584e207c5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:25.336438 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6694d40a-e544-4312-9e07-00d584e207c5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:25.343333 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6694d40a-e544-4312-9e07-00d584e207c5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:25.343857 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6694d40a-e544-4312-9e07-00d584e207c5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:25.344651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6694d40a-e544-4312-9e07-00d584e207c5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:25.345094 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6694d40a-e544-4312-9e07-00d584e207c5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:25.418262 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a2321326-d253-4923-a525-55901e02eece tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:25.418923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a2321326-d253-4923-a525-55901e02eece tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:25.426280 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a2321326-d253-4923-a525-55901e02eece tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:25.426876 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a2321326-d253-4923-a525-55901e02eece tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:25.427944 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a2321326-d253-4923-a525-55901e02eece tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:25.428586 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a2321326-d253-4923-a525-55901e02eece tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:25.505740 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6694d40a-e544-4312-9e07-00d584e207c5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:25.527752 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6694d40a-e544-4312-9e07-00d584e207c5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1708 microversion: 2.1 time: 0.196393 Jun 03 15:29:25.528350 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 200/411] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:25 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1708 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:25.608031 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a2321326-d253-4923-a525-55901e02eece tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:25.618049 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a2321326-d253-4923-a525-55901e02eece tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:25.619745 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a2321326-d253-4923-a525-55901e02eece tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:25.621205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a2321326-d253-4923-a525-55901e02eece tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1739 microversion: 2.20 time: 0.207513 Jun 03 15:29:25.626678 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 212/412] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:25 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:25.627953 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-71fc3bc7-fd71-4f3f-a415-3b9476d27c79 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:25.628558 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-71fc3bc7-fd71-4f3f-a415-3b9476d27c79 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:25.634967 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-71fc3bc7-fd71-4f3f-a415-3b9476d27c79 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:25.635417 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-71fc3bc7-fd71-4f3f-a415-3b9476d27c79 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:25.636236 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-71fc3bc7-fd71-4f3f-a415-3b9476d27c79 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:25.636669 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-71fc3bc7-fd71-4f3f-a415-3b9476d27c79 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:25.858038 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-71fc3bc7-fd71-4f3f-a415-3b9476d27c79 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:25.873051 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-71fc3bc7-fd71-4f3f-a415-3b9476d27c79 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1565 microversion: 2.1 time: 0.248838 Jun 03 15:29:25.885072 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 201/413] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:25 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1565 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:25.890272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1c0ed4bb-2391-41ae-9a54-932027bfd71d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:25.890789 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1c0ed4bb-2391-41ae-9a54-932027bfd71d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:25.898029 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1c0ed4bb-2391-41ae-9a54-932027bfd71d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:25.898479 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1c0ed4bb-2391-41ae-9a54-932027bfd71d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:25.899276 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1c0ed4bb-2391-41ae-9a54-932027bfd71d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:25.899707 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1c0ed4bb-2391-41ae-9a54-932027bfd71d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:25.998341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1c0ed4bb-2391-41ae-9a54-932027bfd71d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111775 Jun 03 15:29:25.998966 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 213/414] 10.222.0.93 () {58 vars in 1274 bytes} [Fri Jun 3 15:29:25 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:29:26.545462 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0b1e870b-56a2-4e98-8836-7c8216844cfb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:26.546297 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0b1e870b-56a2-4e98-8836-7c8216844cfb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:26.553988 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0b1e870b-56a2-4e98-8836-7c8216844cfb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:26.554511 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0b1e870b-56a2-4e98-8836-7c8216844cfb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:26.555366 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0b1e870b-56a2-4e98-8836-7c8216844cfb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:26.555864 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0b1e870b-56a2-4e98-8836-7c8216844cfb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:26.570902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:26.641369 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5c12acce-2ef3-47a7-95ec-26c039ca5749 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:26.642511 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5c12acce-2ef3-47a7-95ec-26c039ca5749 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:26.651888 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c12acce-2ef3-47a7-95ec-26c039ca5749 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:26.652424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c12acce-2ef3-47a7-95ec-26c039ca5749 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:26.653270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c12acce-2ef3-47a7-95ec-26c039ca5749 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:26.653788 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c12acce-2ef3-47a7-95ec-26c039ca5749 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:26.697218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0b1e870b-56a2-4e98-8836-7c8216844cfb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:26.705725 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0b1e870b-56a2-4e98-8836-7c8216844cfb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1708 microversion: 2.1 time: 0.164469 Jun 03 15:29:26.706285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 202/415] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:26 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:26.884770 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5c12acce-2ef3-47a7-95ec-26c039ca5749 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:26.893739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5c12acce-2ef3-47a7-95ec-26c039ca5749 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:26.895509 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5c12acce-2ef3-47a7-95ec-26c039ca5749 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:26.896670 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5c12acce-2ef3-47a7-95ec-26c039ca5749 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1739 microversion: 2.20 time: 0.260449 Jun 03 15:29:26.897230 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 214/416] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:26 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:27.070813 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-0fa4b4f2-e142-4eb3-aba3-b7a6a80d318b req-d5b1f265-eae8-4709-83e9-1c9935a2fedd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99322d93-058a-4216-a672-e7f482aab8d8", "tag": "3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:27.079365 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-0fa4b4f2-e142-4eb3-aba3-b7a6a80d318b req-d5b1f265-eae8-4709-83e9-1c9935a2fedd service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:27.080399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-0fa4b4f2-e142-4eb3-aba3-b7a6a80d318b req-d5b1f265-eae8-4709-83e9-1c9935a2fedd service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:27.092220 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-0fa4b4f2-e142-4eb3-aba3-b7a6a80d318b req-d5b1f265-eae8-4709-83e9-1c9935a2fedd service nova] Creating event network-changed:3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee for instance 99322d93-058a-4216-a672-e7f482aab8d8 on hv-cinder-83124 Jun 03 15:29:27.097532 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-0fa4b4f2-e142-4eb3-aba3-b7a6a80d318b req-d5b1f265-eae8-4709-83e9-1c9935a2fedd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030521 Jun 03 15:29:27.098148 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 203/417] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:29:27.723799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-058ec261-64e6-4e00-8af1-0232350502d7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:27.724408 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-058ec261-64e6-4e00-8af1-0232350502d7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:27.731233 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-058ec261-64e6-4e00-8af1-0232350502d7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:27.731679 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-058ec261-64e6-4e00-8af1-0232350502d7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:27.732447 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-058ec261-64e6-4e00-8af1-0232350502d7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:27.732885 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-058ec261-64e6-4e00-8af1-0232350502d7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:27.869035 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-058ec261-64e6-4e00-8af1-0232350502d7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:27.877492 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-058ec261-64e6-4e00-8af1-0232350502d7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1712 microversion: 2.1 time: 0.158159 Jun 03 15:29:27.878087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 215/418] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:27 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:27.916412 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8fe4ca76-c3c6-4cb5-9060-2a05430b43c8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:27.917206 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8fe4ca76-c3c6-4cb5-9060-2a05430b43c8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:27.924668 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8fe4ca76-c3c6-4cb5-9060-2a05430b43c8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:27.925114 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8fe4ca76-c3c6-4cb5-9060-2a05430b43c8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:27.925880 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8fe4ca76-c3c6-4cb5-9060-2a05430b43c8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:27.926378 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8fe4ca76-c3c6-4cb5-9060-2a05430b43c8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:28.099858 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-8fe4ca76-c3c6-4cb5-9060-2a05430b43c8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:28.108599 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-8fe4ca76-c3c6-4cb5-9060-2a05430b43c8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:28.110900 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-8fe4ca76-c3c6-4cb5-9060-2a05430b43c8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:28.112357 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8fe4ca76-c3c6-4cb5-9060-2a05430b43c8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1721 microversion: 2.20 time: 0.200263 Jun 03 15:29:28.116969 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 204/419] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:27 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:29.131315 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-70281ea1-c8b8-4b4a-a89f-38a9ba1015b2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:29.131903 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-70281ea1-c8b8-4b4a-a89f-38a9ba1015b2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:29.138991 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70281ea1-c8b8-4b4a-a89f-38a9ba1015b2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:29.139438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70281ea1-c8b8-4b4a-a89f-38a9ba1015b2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:29.141627 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70281ea1-c8b8-4b4a-a89f-38a9ba1015b2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:29.142075 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70281ea1-c8b8-4b4a-a89f-38a9ba1015b2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:29.273132 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-70281ea1-c8b8-4b4a-a89f-38a9ba1015b2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:29.281104 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-70281ea1-c8b8-4b4a-a89f-38a9ba1015b2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:29.283139 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-70281ea1-c8b8-4b4a-a89f-38a9ba1015b2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:29.284327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-70281ea1-c8b8-4b4a-a89f-38a9ba1015b2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1721 microversion: 2.20 time: 0.157133 Jun 03 15:29:29.284882 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 216/420] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:29 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:30.302916 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e109c03d-9e90-4eb8-a951-ea6e966864be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:30.303531 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e109c03d-9e90-4eb8-a951-ea6e966864be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:30.310105 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e109c03d-9e90-4eb8-a951-ea6e966864be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:30.310580 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e109c03d-9e90-4eb8-a951-ea6e966864be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:30.311345 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e109c03d-9e90-4eb8-a951-ea6e966864be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:30.311778 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e109c03d-9e90-4eb8-a951-ea6e966864be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:30.441522 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e109c03d-9e90-4eb8-a951-ea6e966864be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:30.449357 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e109c03d-9e90-4eb8-a951-ea6e966864be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:30.450898 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e109c03d-9e90-4eb8-a951-ea6e966864be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:30.452043 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e109c03d-9e90-4eb8-a951-ea6e966864be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1721 microversion: 2.20 time: 0.153039 Jun 03 15:29:30.452610 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 205/421] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:30 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:30.946349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-c1bd61c9-e53c-4304-ab60-d5c3d20f4028 req-6118e549-df7a-4441-98fb-fdda3c868e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123dc0c-78c6-44ce-b847-927843a3751c", "name": "network-vif-unplugged", "status": "completed", "tag": "d065a51d-4c7e-482f-87f7-74c4d679a6c1"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:30.955875 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-c1bd61c9-e53c-4304-ab60-d5c3d20f4028 req-6118e549-df7a-4441-98fb-fdda3c868e56 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:30.956400 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-c1bd61c9-e53c-4304-ab60-d5c3d20f4028 req-6118e549-df7a-4441-98fb-fdda3c868e56 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:30.968657 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-c1bd61c9-e53c-4304-ab60-d5c3d20f4028 req-6118e549-df7a-4441-98fb-fdda3c868e56 service nova] Creating event network-vif-unplugged:d065a51d-4c7e-482f-87f7-74c4d679a6c1 for instance e123dc0c-78c6-44ce-b847-927843a3751c on hv-cinder-83124 Jun 03 15:29:30.974036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-c1bd61c9-e53c-4304-ab60-d5c3d20f4028 req-6118e549-df7a-4441-98fb-fdda3c868e56 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031344 Jun 03 15:29:30.975480 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 217/422] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:29:31.470440 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d05aa7be-db7e-477a-8043-ff892dcd538f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:31.471077 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d05aa7be-db7e-477a-8043-ff892dcd538f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:31.477687 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d05aa7be-db7e-477a-8043-ff892dcd538f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:31.478131 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d05aa7be-db7e-477a-8043-ff892dcd538f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:31.478930 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d05aa7be-db7e-477a-8043-ff892dcd538f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:31.479365 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d05aa7be-db7e-477a-8043-ff892dcd538f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:31.621594 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d05aa7be-db7e-477a-8043-ff892dcd538f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:31.629432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d05aa7be-db7e-477a-8043-ff892dcd538f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:31.631050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d05aa7be-db7e-477a-8043-ff892dcd538f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:31.632229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d05aa7be-db7e-477a-8043-ff892dcd538f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1724 microversion: 2.20 time: 0.166168 Jun 03 15:29:31.632782 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 206/423] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:31 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:31.650136 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-50f3f2a9-a3ad-40fe-b5d8-ed04588ae0d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3ba06d0-6f0d-4a83-8854-45bcc7c08c35"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:31.651334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-50f3f2a9-a3ad-40fe-b5d8-ed04588ae0d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:31.658324 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50f3f2a9-a3ad-40fe-b5d8-ed04588ae0d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:31.658790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50f3f2a9-a3ad-40fe-b5d8-ed04588ae0d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:31.659549 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50f3f2a9-a3ad-40fe-b5d8-ed04588ae0d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:31.659977 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50f3f2a9-a3ad-40fe-b5d8-ed04588ae0d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:31.941457 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-50f3f2a9-a3ad-40fe-b5d8-ed04588ae0d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "POST /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295327 Jun 03 15:29:31.942056 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 218/424] 10.222.0.93 () {62 vars in 1363 bytes} [Fri Jun 3 15:29:31 2022] POST /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:29:32.054148 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-94f696d5-d0e0-4cdf-824d-0f53b8fa6628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:32.054746 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-94f696d5-d0e0-4cdf-824d-0f53b8fa6628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:32.060772 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-94f696d5-d0e0-4cdf-824d-0f53b8fa6628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:32.061220 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-94f696d5-d0e0-4cdf-824d-0f53b8fa6628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:32.061983 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-94f696d5-d0e0-4cdf-824d-0f53b8fa6628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:32.062421 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-94f696d5-d0e0-4cdf-824d-0f53b8fa6628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:32.155634 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-94f696d5-d0e0-4cdf-824d-0f53b8fa6628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "POST /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/action" status: 202 len: 0 microversion: 2.20 time: 0.105374 Jun 03 15:29:32.156233 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 207/425] 10.222.0.93 () {62 vars in 1318 bytes} [Fri Jun 3 15:29:32 2022] POST /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:29:32.165187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7ef14a77-49d1-4fd6-bc46-0eb6c0286858 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:32.165808 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7ef14a77-49d1-4fd6-bc46-0eb6c0286858 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:32.177776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7ef14a77-49d1-4fd6-bc46-0eb6c0286858 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:32.178224 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7ef14a77-49d1-4fd6-bc46-0eb6c0286858 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:32.179023 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7ef14a77-49d1-4fd6-bc46-0eb6c0286858 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:32.179472 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7ef14a77-49d1-4fd6-bc46-0eb6c0286858 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:32.311824 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7ef14a77-49d1-4fd6-bc46-0eb6c0286858 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:32.320793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7ef14a77-49d1-4fd6-bc46-0eb6c0286858 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:32.322297 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7ef14a77-49d1-4fd6-bc46-0eb6c0286858 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:32.323466 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7ef14a77-49d1-4fd6-bc46-0eb6c0286858 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1750 microversion: 2.20 time: 0.163036 Jun 03 15:29:32.324020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 219/426] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:32 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:33.342828 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f2b9c7c4-40a5-4c29-8b87-882c796a7248 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:33.343808 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f2b9c7c4-40a5-4c29-8b87-882c796a7248 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:33.350343 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f2b9c7c4-40a5-4c29-8b87-882c796a7248 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:33.350825 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f2b9c7c4-40a5-4c29-8b87-882c796a7248 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:33.351605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f2b9c7c4-40a5-4c29-8b87-882c796a7248 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:33.352043 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f2b9c7c4-40a5-4c29-8b87-882c796a7248 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:33.481738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f2b9c7c4-40a5-4c29-8b87-882c796a7248 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:33.490860 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f2b9c7c4-40a5-4c29-8b87-882c796a7248 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:33.492367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f2b9c7c4-40a5-4c29-8b87-882c796a7248 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:33.493515 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f2b9c7c4-40a5-4c29-8b87-882c796a7248 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1752 microversion: 2.20 time: 0.155208 Jun 03 15:29:33.494065 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 208/427] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:33 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:34.512041 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d2f0c8a3-2e32-454c-aaa7-3682c674d8a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:34.513260 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d2f0c8a3-2e32-454c-aaa7-3682c674d8a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:34.521051 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d2f0c8a3-2e32-454c-aaa7-3682c674d8a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:34.521715 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d2f0c8a3-2e32-454c-aaa7-3682c674d8a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:34.522676 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d2f0c8a3-2e32-454c-aaa7-3682c674d8a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:34.523336 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d2f0c8a3-2e32-454c-aaa7-3682c674d8a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:34.679986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d2f0c8a3-2e32-454c-aaa7-3682c674d8a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:34.688363 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d2f0c8a3-2e32-454c-aaa7-3682c674d8a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:34.690560 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d2f0c8a3-2e32-454c-aaa7-3682c674d8a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:34.691705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d2f0c8a3-2e32-454c-aaa7-3682c674d8a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.183598 Jun 03 15:29:34.692266 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 220/428] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:34 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:35.709888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e0f67ae3-2e13-4fbe-93c4-1223ef77d264 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:35.710553 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e0f67ae3-2e13-4fbe-93c4-1223ef77d264 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:35.717317 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e0f67ae3-2e13-4fbe-93c4-1223ef77d264 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:35.717770 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e0f67ae3-2e13-4fbe-93c4-1223ef77d264 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:35.718577 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e0f67ae3-2e13-4fbe-93c4-1223ef77d264 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:35.719018 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e0f67ae3-2e13-4fbe-93c4-1223ef77d264 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:35.850752 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e0f67ae3-2e13-4fbe-93c4-1223ef77d264 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:35.859542 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e0f67ae3-2e13-4fbe-93c4-1223ef77d264 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:35.861071 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e0f67ae3-2e13-4fbe-93c4-1223ef77d264 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:35.862232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e0f67ae3-2e13-4fbe-93c4-1223ef77d264 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.156433 Jun 03 15:29:35.862892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 209/429] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:35 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:36.387349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3807d5fd-d944-462c-92a3-638f114d03e6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:29:36.388488 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3807d5fd-d944-462c-92a3-638f114d03e6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:36.395668 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3807d5fd-d944-462c-92a3-638f114d03e6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:36.396149 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3807d5fd-d944-462c-92a3-638f114d03e6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:36.397198 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3807d5fd-d944-462c-92a3-638f114d03e6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:36.397691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3807d5fd-d944-462c-92a3-638f114d03e6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:36.476446 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3807d5fd-d944-462c-92a3-638f114d03e6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "POST /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/action" status: 202 len: 0 microversion: 2.1 time: 0.092586 Jun 03 15:29:36.480399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 221/430] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:29:36 2022] POST /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:29:36.487255 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8a1ac300-550a-4cfe-968b-f46b3e1e372b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:36.487875 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8a1ac300-550a-4cfe-968b-f46b3e1e372b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:36.497835 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8a1ac300-550a-4cfe-968b-f46b3e1e372b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:36.498569 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8a1ac300-550a-4cfe-968b-f46b3e1e372b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:36.499368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8a1ac300-550a-4cfe-968b-f46b3e1e372b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:36.499783 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8a1ac300-550a-4cfe-968b-f46b3e1e372b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:36.736047 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-8a1ac300-550a-4cfe-968b-f46b3e1e372b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:36.745764 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8a1ac300-550a-4cfe-968b-f46b3e1e372b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.264013 Jun 03 15:29:36.757601 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 210/431] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:36 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:36.881660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e292cfbf-2482-462a-ba1f-73fe7f00dea6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:36.882276 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e292cfbf-2482-462a-ba1f-73fe7f00dea6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:36.888609 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e292cfbf-2482-462a-ba1f-73fe7f00dea6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:36.889065 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e292cfbf-2482-462a-ba1f-73fe7f00dea6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:36.889831 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e292cfbf-2482-462a-ba1f-73fe7f00dea6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:36.890272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e292cfbf-2482-462a-ba1f-73fe7f00dea6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:37.031785 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e292cfbf-2482-462a-ba1f-73fe7f00dea6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:37.040522 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e292cfbf-2482-462a-ba1f-73fe7f00dea6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:37.042020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e292cfbf-2482-462a-ba1f-73fe7f00dea6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:37.043199 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e292cfbf-2482-462a-ba1f-73fe7f00dea6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.165939 Jun 03 15:29:37.043774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 222/432] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:36 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:37.765076 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f747cf11-4239-4343-be9f-0a2275f8149a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:37.765685 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f747cf11-4239-4343-be9f-0a2275f8149a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:37.773464 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f747cf11-4239-4343-be9f-0a2275f8149a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:37.773907 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f747cf11-4239-4343-be9f-0a2275f8149a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:37.774700 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f747cf11-4239-4343-be9f-0a2275f8149a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:37.775131 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f747cf11-4239-4343-be9f-0a2275f8149a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:37.919290 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f747cf11-4239-4343-be9f-0a2275f8149a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:37.928078 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f747cf11-4239-4343-be9f-0a2275f8149a tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.166629 Jun 03 15:29:37.938068 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 211/433] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:37 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:38.062032 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-44105306-f782-4876-99ce-e8651ca2826e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:38.062731 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-44105306-f782-4876-99ce-e8651ca2826e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:38.069787 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-44105306-f782-4876-99ce-e8651ca2826e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:38.070236 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-44105306-f782-4876-99ce-e8651ca2826e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:38.071032 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-44105306-f782-4876-99ce-e8651ca2826e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:38.071468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-44105306-f782-4876-99ce-e8651ca2826e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:38.074159 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:38.202216 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-44105306-f782-4876-99ce-e8651ca2826e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:38.211300 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-44105306-f782-4876-99ce-e8651ca2826e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:38.213185 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-44105306-f782-4876-99ce-e8651ca2826e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:38.214613 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-44105306-f782-4876-99ce-e8651ca2826e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.156390 Jun 03 15:29:38.215248 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 223/434] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:38 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:38.945689 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c7aa0cac-766a-49c4-8b71-ccecbd83d8fa tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:38.946271 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c7aa0cac-766a-49c4-8b71-ccecbd83d8fa tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:38.952861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c7aa0cac-766a-49c4-8b71-ccecbd83d8fa tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:38.953311 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c7aa0cac-766a-49c4-8b71-ccecbd83d8fa tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:38.954821 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c7aa0cac-766a-49c4-8b71-ccecbd83d8fa tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:38.955802 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c7aa0cac-766a-49c4-8b71-ccecbd83d8fa tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:39.099305 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c7aa0cac-766a-49c4-8b71-ccecbd83d8fa tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:39.107212 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c7aa0cac-766a-49c4-8b71-ccecbd83d8fa tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.165535 Jun 03 15:29:39.107775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 212/435] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:38 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:39.233314 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-075789b9-60fd-44dd-ba8e-517c19a9aec6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:39.233941 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-075789b9-60fd-44dd-ba8e-517c19a9aec6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:39.241041 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-075789b9-60fd-44dd-ba8e-517c19a9aec6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:39.241490 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-075789b9-60fd-44dd-ba8e-517c19a9aec6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:39.242259 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-075789b9-60fd-44dd-ba8e-517c19a9aec6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:39.242747 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-075789b9-60fd-44dd-ba8e-517c19a9aec6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:39.378828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-075789b9-60fd-44dd-ba8e-517c19a9aec6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:39.387137 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-075789b9-60fd-44dd-ba8e-517c19a9aec6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:39.388627 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-075789b9-60fd-44dd-ba8e-517c19a9aec6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:39.389769 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-075789b9-60fd-44dd-ba8e-517c19a9aec6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.160570 Jun 03 15:29:39.390332 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 224/436] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:39 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:40.124197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a39e1db7-b6d3-417a-86d7-a3dd90f7f8ca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:40.124781 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a39e1db7-b6d3-417a-86d7-a3dd90f7f8ca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:40.131999 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a39e1db7-b6d3-417a-86d7-a3dd90f7f8ca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:40.132441 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a39e1db7-b6d3-417a-86d7-a3dd90f7f8ca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:40.133193 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a39e1db7-b6d3-417a-86d7-a3dd90f7f8ca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:40.133621 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a39e1db7-b6d3-417a-86d7-a3dd90f7f8ca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:40.280830 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a39e1db7-b6d3-417a-86d7-a3dd90f7f8ca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:40.289196 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a39e1db7-b6d3-417a-86d7-a3dd90f7f8ca tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.168819 Jun 03 15:29:40.289760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 213/437] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:40 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:40.408641 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6fccde1e-5b20-4058-b65f-c55e796045d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:40.409184 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6fccde1e-5b20-4058-b65f-c55e796045d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:40.416080 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6fccde1e-5b20-4058-b65f-c55e796045d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:40.416507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6fccde1e-5b20-4058-b65f-c55e796045d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:40.417275 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6fccde1e-5b20-4058-b65f-c55e796045d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:40.417700 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6fccde1e-5b20-4058-b65f-c55e796045d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:40.550327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6fccde1e-5b20-4058-b65f-c55e796045d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:40.558742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6fccde1e-5b20-4058-b65f-c55e796045d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:40.560227 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6fccde1e-5b20-4058-b65f-c55e796045d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:40.561355 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6fccde1e-5b20-4058-b65f-c55e796045d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.157153 Jun 03 15:29:40.561908 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 225/438] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:40 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:41.307061 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-69128d3a-8049-48bb-8221-b522b3caca9c tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:41.307683 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-69128d3a-8049-48bb-8221-b522b3caca9c tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:41.314739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-69128d3a-8049-48bb-8221-b522b3caca9c tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:41.315192 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-69128d3a-8049-48bb-8221-b522b3caca9c tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:41.315958 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-69128d3a-8049-48bb-8221-b522b3caca9c tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:41.316405 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-69128d3a-8049-48bb-8221-b522b3caca9c tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:41.459877 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-69128d3a-8049-48bb-8221-b522b3caca9c tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:41.473375 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-69128d3a-8049-48bb-8221-b522b3caca9c tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.170036 Jun 03 15:29:41.477060 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 214/439] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:41 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:29:41.579846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a34957fe-ed7f-4174-9b5b-eeba646c2efe tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:41.580393 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a34957fe-ed7f-4174-9b5b-eeba646c2efe tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:41.587012 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a34957fe-ed7f-4174-9b5b-eeba646c2efe tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:41.587456 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a34957fe-ed7f-4174-9b5b-eeba646c2efe tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:41.588208 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a34957fe-ed7f-4174-9b5b-eeba646c2efe tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:41.588660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a34957fe-ed7f-4174-9b5b-eeba646c2efe tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:41.724095 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a34957fe-ed7f-4174-9b5b-eeba646c2efe tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:41.733262 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a34957fe-ed7f-4174-9b5b-eeba646c2efe tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:41.734789 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a34957fe-ed7f-4174-9b5b-eeba646c2efe tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:41.736473 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a34957fe-ed7f-4174-9b5b-eeba646c2efe tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.160588 Jun 03 15:29:41.737124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 226/440] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:41 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:42.492285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c45f84ad-d9ed-4959-bcef-9965b67b2d14 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:42.492999 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c45f84ad-d9ed-4959-bcef-9965b67b2d14 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:42.499664 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c45f84ad-d9ed-4959-bcef-9965b67b2d14 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:42.500120 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c45f84ad-d9ed-4959-bcef-9965b67b2d14 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:42.501587 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c45f84ad-d9ed-4959-bcef-9965b67b2d14 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:42.502032 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c45f84ad-d9ed-4959-bcef-9965b67b2d14 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:42.645595 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c45f84ad-d9ed-4959-bcef-9965b67b2d14 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:42.653608 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c45f84ad-d9ed-4959-bcef-9965b67b2d14 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.165227 Jun 03 15:29:42.654176 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 215/441] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:42 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:42.755484 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d83cec2f-e9bd-4916-954a-1cfeb6508951 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:42.756077 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d83cec2f-e9bd-4916-954a-1cfeb6508951 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:42.762873 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d83cec2f-e9bd-4916-954a-1cfeb6508951 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:42.763320 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d83cec2f-e9bd-4916-954a-1cfeb6508951 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:42.764242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d83cec2f-e9bd-4916-954a-1cfeb6508951 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:42.764679 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d83cec2f-e9bd-4916-954a-1cfeb6508951 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:42.897914 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d83cec2f-e9bd-4916-954a-1cfeb6508951 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:42.907654 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d83cec2f-e9bd-4916-954a-1cfeb6508951 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:42.909942 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d83cec2f-e9bd-4916-954a-1cfeb6508951 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:42.911131 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d83cec2f-e9bd-4916-954a-1cfeb6508951 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.159632 Jun 03 15:29:42.911703 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 227/442] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:42 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:43.671590 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-68db58f2-a963-40d9-af72-9b2446207928 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:43.672194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-68db58f2-a963-40d9-af72-9b2446207928 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:43.679387 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-68db58f2-a963-40d9-af72-9b2446207928 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:43.679835 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-68db58f2-a963-40d9-af72-9b2446207928 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:43.680611 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-68db58f2-a963-40d9-af72-9b2446207928 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:43.681047 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-68db58f2-a963-40d9-af72-9b2446207928 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:43.822137 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-68db58f2-a963-40d9-af72-9b2446207928 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:43.831726 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-68db58f2-a963-40d9-af72-9b2446207928 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.164013 Jun 03 15:29:43.842959 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 216/443] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:43 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:43.929759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1c54ecae-bcdc-42da-8188-63e52e13aa46 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:43.930292 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1c54ecae-bcdc-42da-8188-63e52e13aa46 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:43.936949 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1c54ecae-bcdc-42da-8188-63e52e13aa46 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:43.937395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1c54ecae-bcdc-42da-8188-63e52e13aa46 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:43.938834 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1c54ecae-bcdc-42da-8188-63e52e13aa46 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:43.939274 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1c54ecae-bcdc-42da-8188-63e52e13aa46 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:44.072202 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1c54ecae-bcdc-42da-8188-63e52e13aa46 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:44.080821 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1c54ecae-bcdc-42da-8188-63e52e13aa46 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:44.082497 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1c54ecae-bcdc-42da-8188-63e52e13aa46 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:44.083754 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1c54ecae-bcdc-42da-8188-63e52e13aa46 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.158101 Jun 03 15:29:44.084322 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 228/444] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:43 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:29:44.850745 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-de57a02b-2302-47ac-9217-7fcd201e61a7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:44.851409 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-de57a02b-2302-47ac-9217-7fcd201e61a7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:44.857985 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-de57a02b-2302-47ac-9217-7fcd201e61a7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:44.858436 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-de57a02b-2302-47ac-9217-7fcd201e61a7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:44.859243 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-de57a02b-2302-47ac-9217-7fcd201e61a7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:44.859695 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-de57a02b-2302-47ac-9217-7fcd201e61a7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:45.024346 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-de57a02b-2302-47ac-9217-7fcd201e61a7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:45.032365 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-de57a02b-2302-47ac-9217-7fcd201e61a7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.185678 Jun 03 15:29:45.032929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 217/445] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:44 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:45.101377 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7430cc35-7dfa-4f92-9341-acdcd39a86dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:45.101985 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7430cc35-7dfa-4f92-9341-acdcd39a86dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:45.109162 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7430cc35-7dfa-4f92-9341-acdcd39a86dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:45.109622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7430cc35-7dfa-4f92-9341-acdcd39a86dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:45.110479 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7430cc35-7dfa-4f92-9341-acdcd39a86dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:45.110899 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7430cc35-7dfa-4f92-9341-acdcd39a86dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:45.255394 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7430cc35-7dfa-4f92-9341-acdcd39a86dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:45.264161 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7430cc35-7dfa-4f92-9341-acdcd39a86dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:45.265659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7430cc35-7dfa-4f92-9341-acdcd39a86dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:45.266869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7430cc35-7dfa-4f92-9341-acdcd39a86dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.169406 Jun 03 15:29:45.267440 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 229/446] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:45 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:46.049699 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c05956e3-2ac9-4560-bf41-b286546d46b2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:46.050347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c05956e3-2ac9-4560-bf41-b286546d46b2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:46.056821 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c05956e3-2ac9-4560-bf41-b286546d46b2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:46.057264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c05956e3-2ac9-4560-bf41-b286546d46b2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:46.058012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c05956e3-2ac9-4560-bf41-b286546d46b2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:46.058443 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c05956e3-2ac9-4560-bf41-b286546d46b2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:46.208631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c05956e3-2ac9-4560-bf41-b286546d46b2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:46.210888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:46.218845 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c05956e3-2ac9-4560-bf41-b286546d46b2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.172866 Jun 03 15:29:46.220048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 218/447] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:46 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:46.285282 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9ccc39d0-abce-445a-9d75-84e0a209f467 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:46.285901 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9ccc39d0-abce-445a-9d75-84e0a209f467 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:46.295832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9ccc39d0-abce-445a-9d75-84e0a209f467 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:46.296272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9ccc39d0-abce-445a-9d75-84e0a209f467 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:46.297035 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9ccc39d0-abce-445a-9d75-84e0a209f467 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:46.297513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9ccc39d0-abce-445a-9d75-84e0a209f467 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:46.434380 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9ccc39d0-abce-445a-9d75-84e0a209f467 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:46.445693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9ccc39d0-abce-445a-9d75-84e0a209f467 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:46.447361 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9ccc39d0-abce-445a-9d75-84e0a209f467 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:46.448866 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9ccc39d0-abce-445a-9d75-84e0a209f467 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.168107 Jun 03 15:29:46.450118 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 230/448] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:46 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:47.237825 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2672bb16-84a9-45f3-a653-604cd0f9be87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:47.238468 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2672bb16-84a9-45f3-a653-604cd0f9be87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:47.245407 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2672bb16-84a9-45f3-a653-604cd0f9be87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:47.245850 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2672bb16-84a9-45f3-a653-604cd0f9be87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:47.246683 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2672bb16-84a9-45f3-a653-604cd0f9be87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:47.247113 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2672bb16-84a9-45f3-a653-604cd0f9be87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:47.400719 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2672bb16-84a9-45f3-a653-604cd0f9be87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:47.409146 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2672bb16-84a9-45f3-a653-604cd0f9be87 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.176484 Jun 03 15:29:47.409723 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 219/449] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:47 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:47.467938 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9e220f76-b164-4dba-9019-ae8ed6cc4424 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:47.468541 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9e220f76-b164-4dba-9019-ae8ed6cc4424 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:47.475774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e220f76-b164-4dba-9019-ae8ed6cc4424 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:47.476221 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e220f76-b164-4dba-9019-ae8ed6cc4424 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:47.476997 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e220f76-b164-4dba-9019-ae8ed6cc4424 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:47.477429 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e220f76-b164-4dba-9019-ae8ed6cc4424 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:47.617645 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9e220f76-b164-4dba-9019-ae8ed6cc4424 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:47.626042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9e220f76-b164-4dba-9019-ae8ed6cc4424 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:47.627652 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9e220f76-b164-4dba-9019-ae8ed6cc4424 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:47.628816 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9e220f76-b164-4dba-9019-ae8ed6cc4424 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.164836 Jun 03 15:29:47.629370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 231/450] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:47 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:48.426457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1be14949-8893-4fcc-8f66-dc6219de06b9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:48.427188 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1be14949-8893-4fcc-8f66-dc6219de06b9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:48.433557 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1be14949-8893-4fcc-8f66-dc6219de06b9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:48.434012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1be14949-8893-4fcc-8f66-dc6219de06b9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:48.434790 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1be14949-8893-4fcc-8f66-dc6219de06b9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:48.435224 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1be14949-8893-4fcc-8f66-dc6219de06b9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:48.574599 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-1be14949-8893-4fcc-8f66-dc6219de06b9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:48.583240 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1be14949-8893-4fcc-8f66-dc6219de06b9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.160643 Jun 03 15:29:48.583817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 220/451] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:48 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:48.648172 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d5327767-14c7-4beb-9000-0d22f021b57a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:48.648761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d5327767-14c7-4beb-9000-0d22f021b57a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:48.655495 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d5327767-14c7-4beb-9000-0d22f021b57a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:48.655934 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d5327767-14c7-4beb-9000-0d22f021b57a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:48.656732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d5327767-14c7-4beb-9000-0d22f021b57a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:48.657167 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d5327767-14c7-4beb-9000-0d22f021b57a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:48.790508 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d5327767-14c7-4beb-9000-0d22f021b57a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:48.817832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d5327767-14c7-4beb-9000-0d22f021b57a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:48.819628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d5327767-14c7-4beb-9000-0d22f021b57a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:48.820829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d5327767-14c7-4beb-9000-0d22f021b57a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.176509 Jun 03 15:29:48.821386 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 232/452] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:48 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:49.600158 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c0480c9e-83f9-4c59-be56-33cd4e0ba60e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:49.601387 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c0480c9e-83f9-4c59-be56-33cd4e0ba60e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:49.607960 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c0480c9e-83f9-4c59-be56-33cd4e0ba60e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:49.608407 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c0480c9e-83f9-4c59-be56-33cd4e0ba60e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:49.609165 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c0480c9e-83f9-4c59-be56-33cd4e0ba60e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:49.609595 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c0480c9e-83f9-4c59-be56-33cd4e0ba60e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:49.767132 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c0480c9e-83f9-4c59-be56-33cd4e0ba60e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:49.775521 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c0480c9e-83f9-4c59-be56-33cd4e0ba60e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.179262 Jun 03 15:29:49.776092 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 221/453] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:49 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:49.839500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6e36cc71-26c3-405e-ba4f-d15bf12193e2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:49.840112 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6e36cc71-26c3-405e-ba4f-d15bf12193e2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:49.842405 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=58 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:49.848733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e36cc71-26c3-405e-ba4f-d15bf12193e2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:49.849195 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e36cc71-26c3-405e-ba4f-d15bf12193e2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:49.849963 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e36cc71-26c3-405e-ba4f-d15bf12193e2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:49.850452 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e36cc71-26c3-405e-ba4f-d15bf12193e2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:49.992056 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6e36cc71-26c3-405e-ba4f-d15bf12193e2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:50.002057 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6e36cc71-26c3-405e-ba4f-d15bf12193e2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:50.003658 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6e36cc71-26c3-405e-ba4f-d15bf12193e2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:50.004886 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6e36cc71-26c3-405e-ba4f-d15bf12193e2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.169295 Jun 03 15:29:50.005748 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 233/454] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:49 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:50.793244 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-755a8634-535e-4538-997d-f6241cf9d607 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:50.793846 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-755a8634-535e-4538-997d-f6241cf9d607 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:50.796748 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=62 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:50.803001 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-755a8634-535e-4538-997d-f6241cf9d607 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:50.803453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-755a8634-535e-4538-997d-f6241cf9d607 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:50.804219 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-755a8634-535e-4538-997d-f6241cf9d607 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:50.804651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-755a8634-535e-4538-997d-f6241cf9d607 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:50.955322 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-755a8634-535e-4538-997d-f6241cf9d607 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:50.964137 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-755a8634-535e-4538-997d-f6241cf9d607 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.174762 Jun 03 15:29:50.971312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 222/455] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:50 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:51.023113 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8d53e8f7-65af-4f92-a5f4-9af25b0647b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:51.023738 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8d53e8f7-65af-4f92-a5f4-9af25b0647b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:51.030465 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8d53e8f7-65af-4f92-a5f4-9af25b0647b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:51.030948 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8d53e8f7-65af-4f92-a5f4-9af25b0647b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:51.031725 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8d53e8f7-65af-4f92-a5f4-9af25b0647b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:51.032823 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8d53e8f7-65af-4f92-a5f4-9af25b0647b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:51.161590 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8d53e8f7-65af-4f92-a5f4-9af25b0647b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:51.169925 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8d53e8f7-65af-4f92-a5f4-9af25b0647b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:51.171464 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8d53e8f7-65af-4f92-a5f4-9af25b0647b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:51.173242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8d53e8f7-65af-4f92-a5f4-9af25b0647b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.153431 Jun 03 15:29:51.173798 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 234/456] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:51 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:51.982951 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ec8a756e-dd2f-46a4-bec2-bb2be2fa1779 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:51.984761 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ec8a756e-dd2f-46a4-bec2-bb2be2fa1779 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:51.992794 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec8a756e-dd2f-46a4-bec2-bb2be2fa1779 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:51.993249 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec8a756e-dd2f-46a4-bec2-bb2be2fa1779 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:51.994028 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec8a756e-dd2f-46a4-bec2-bb2be2fa1779 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:51.994496 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec8a756e-dd2f-46a4-bec2-bb2be2fa1779 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:52.137457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ec8a756e-dd2f-46a4-bec2-bb2be2fa1779 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:52.145937 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ec8a756e-dd2f-46a4-bec2-bb2be2fa1779 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.167900 Jun 03 15:29:52.146507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 223/457] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:51 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:52.194350 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-70b4a762-88e2-4dbf-b146-78f7da960a6d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:52.195493 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-70b4a762-88e2-4dbf-b146-78f7da960a6d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:52.202212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70b4a762-88e2-4dbf-b146-78f7da960a6d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:52.202708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70b4a762-88e2-4dbf-b146-78f7da960a6d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:52.203483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70b4a762-88e2-4dbf-b146-78f7da960a6d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:52.203985 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70b4a762-88e2-4dbf-b146-78f7da960a6d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:52.347553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-70b4a762-88e2-4dbf-b146-78f7da960a6d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:52.363186 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-70b4a762-88e2-4dbf-b146-78f7da960a6d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:52.365069 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-70b4a762-88e2-4dbf-b146-78f7da960a6d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:52.366337 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-70b4a762-88e2-4dbf-b146-78f7da960a6d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.178850 Jun 03 15:29:52.367006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 235/458] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:52 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:53.164552 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e5626882-c6db-4fbc-b4dc-d8130ac0c808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:53.166355 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e5626882-c6db-4fbc-b4dc-d8130ac0c808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:53.174385 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5626882-c6db-4fbc-b4dc-d8130ac0c808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:53.174877 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5626882-c6db-4fbc-b4dc-d8130ac0c808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:53.175918 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5626882-c6db-4fbc-b4dc-d8130ac0c808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:53.176353 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5626882-c6db-4fbc-b4dc-d8130ac0c808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:53.321137 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e5626882-c6db-4fbc-b4dc-d8130ac0c808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:53.331396 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e5626882-c6db-4fbc-b4dc-d8130ac0c808 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.171702 Jun 03 15:29:53.332609 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 224/459] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:53 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:53.385362 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6ae8a236-c1ff-447a-9419-59e3f549c235 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:53.385972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6ae8a236-c1ff-447a-9419-59e3f549c235 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:53.395063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6ae8a236-c1ff-447a-9419-59e3f549c235 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:53.395780 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6ae8a236-c1ff-447a-9419-59e3f549c235 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:53.396717 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6ae8a236-c1ff-447a-9419-59e3f549c235 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:53.397317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6ae8a236-c1ff-447a-9419-59e3f549c235 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:53.534207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6ae8a236-c1ff-447a-9419-59e3f549c235 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:53.542990 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6ae8a236-c1ff-447a-9419-59e3f549c235 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:53.544553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6ae8a236-c1ff-447a-9419-59e3f549c235 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:53.545705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6ae8a236-c1ff-447a-9419-59e3f549c235 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.164331 Jun 03 15:29:53.546264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 236/460] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:53 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:54.350290 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a73cbec4-dff9-48e0-8502-463852009723 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:54.350914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a73cbec4-dff9-48e0-8502-463852009723 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:54.357423 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a73cbec4-dff9-48e0-8502-463852009723 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:54.357866 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a73cbec4-dff9-48e0-8502-463852009723 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:54.358646 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a73cbec4-dff9-48e0-8502-463852009723 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:54.359076 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a73cbec4-dff9-48e0-8502-463852009723 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:54.499501 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a73cbec4-dff9-48e0-8502-463852009723 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:54.507551 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a73cbec4-dff9-48e0-8502-463852009723 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.161062 Jun 03 15:29:54.508110 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 225/461] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:54 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:54.564865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-38cdf8c3-3c22-43fc-b562-6e72a42845be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:54.565476 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-38cdf8c3-3c22-43fc-b562-6e72a42845be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:54.572111 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-38cdf8c3-3c22-43fc-b562-6e72a42845be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:54.572564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-38cdf8c3-3c22-43fc-b562-6e72a42845be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:54.573333 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-38cdf8c3-3c22-43fc-b562-6e72a42845be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:54.573774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-38cdf8c3-3c22-43fc-b562-6e72a42845be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:54.702829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-38cdf8c3-3c22-43fc-b562-6e72a42845be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:54.711778 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-38cdf8c3-3c22-43fc-b562-6e72a42845be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:54.713296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-38cdf8c3-3c22-43fc-b562-6e72a42845be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:54.714432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-38cdf8c3-3c22-43fc-b562-6e72a42845be tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.153975 Jun 03 15:29:54.715006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 237/462] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:54 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:55.525128 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cb80b072-b22e-437d-8a8d-53d35b39d746 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:55.525742 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-cb80b072-b22e-437d-8a8d-53d35b39d746 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:55.532842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cb80b072-b22e-437d-8a8d-53d35b39d746 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:55.533291 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cb80b072-b22e-437d-8a8d-53d35b39d746 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:55.534058 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cb80b072-b22e-437d-8a8d-53d35b39d746 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:55.534495 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cb80b072-b22e-437d-8a8d-53d35b39d746 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:55.679420 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-cb80b072-b22e-437d-8a8d-53d35b39d746 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:55.687389 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-cb80b072-b22e-437d-8a8d-53d35b39d746 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.166194 Jun 03 15:29:55.687949 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 226/463] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:55 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:55.732422 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-87284f5e-36a0-4deb-b10e-17ef2fea47d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:55.733052 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-87284f5e-36a0-4deb-b10e-17ef2fea47d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:55.739647 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-87284f5e-36a0-4deb-b10e-17ef2fea47d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:55.740086 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-87284f5e-36a0-4deb-b10e-17ef2fea47d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:55.740840 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-87284f5e-36a0-4deb-b10e-17ef2fea47d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:55.741266 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-87284f5e-36a0-4deb-b10e-17ef2fea47d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:55.868533 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-87284f5e-36a0-4deb-b10e-17ef2fea47d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:55.876850 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-87284f5e-36a0-4deb-b10e-17ef2fea47d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:55.878342 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-87284f5e-36a0-4deb-b10e-17ef2fea47d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:55.879534 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-87284f5e-36a0-4deb-b10e-17ef2fea47d3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.151034 Jun 03 15:29:55.880109 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 238/464] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:55 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:56.704403 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4dbb69c0-4ff9-487a-8c4c-1a2c9e3a0095 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:56.705011 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4dbb69c0-4ff9-487a-8c4c-1a2c9e3a0095 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:56.711601 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4dbb69c0-4ff9-487a-8c4c-1a2c9e3a0095 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:56.712047 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4dbb69c0-4ff9-487a-8c4c-1a2c9e3a0095 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:56.712817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4dbb69c0-4ff9-487a-8c4c-1a2c9e3a0095 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:56.713278 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4dbb69c0-4ff9-487a-8c4c-1a2c9e3a0095 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:56.877628 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4dbb69c0-4ff9-487a-8c4c-1a2c9e3a0095 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:56.885917 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4dbb69c0-4ff9-487a-8c4c-1a2c9e3a0095 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1750 microversion: 2.1 time: 0.185297 Jun 03 15:29:56.886476 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 227/465] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:56 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:56.897378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0050cfff-bba5-4cd7-9f11-77c5aefc8e2c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:56.897989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0050cfff-bba5-4cd7-9f11-77c5aefc8e2c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:56.905017 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0050cfff-bba5-4cd7-9f11-77c5aefc8e2c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:56.905466 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0050cfff-bba5-4cd7-9f11-77c5aefc8e2c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:56.906330 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0050cfff-bba5-4cd7-9f11-77c5aefc8e2c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:56.907287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0050cfff-bba5-4cd7-9f11-77c5aefc8e2c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:57.043378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0050cfff-bba5-4cd7-9f11-77c5aefc8e2c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:57.045584 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=100 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:29:57.053738 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0050cfff-bba5-4cd7-9f11-77c5aefc8e2c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:57.055263 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0050cfff-bba5-4cd7-9f11-77c5aefc8e2c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:57.056400 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0050cfff-bba5-4cd7-9f11-77c5aefc8e2c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.163222 Jun 03 15:29:57.056974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 239/466] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:56 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:57.903508 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f5bb660f-0671-44f1-8b66-03e8cbc1c51f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:57.904116 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f5bb660f-0671-44f1-8b66-03e8cbc1c51f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:57.911449 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f5bb660f-0671-44f1-8b66-03e8cbc1c51f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:57.911908 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f5bb660f-0671-44f1-8b66-03e8cbc1c51f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:57.912691 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f5bb660f-0671-44f1-8b66-03e8cbc1c51f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:57.913139 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f5bb660f-0671-44f1-8b66-03e8cbc1c51f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:58.052690 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f5bb660f-0671-44f1-8b66-03e8cbc1c51f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:58.060635 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f5bb660f-0671-44f1-8b66-03e8cbc1c51f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.161012 Jun 03 15:29:58.061207 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 228/467] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:57 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:58.073618 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-00e22861-718b-44cd-8ac9-ac6d5d189e94 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:58.074225 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-00e22861-718b-44cd-8ac9-ac6d5d189e94 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:58.081296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-00e22861-718b-44cd-8ac9-ac6d5d189e94 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:58.081743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-00e22861-718b-44cd-8ac9-ac6d5d189e94 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:58.082512 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-00e22861-718b-44cd-8ac9-ac6d5d189e94 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:58.082974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-00e22861-718b-44cd-8ac9-ac6d5d189e94 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:58.212368 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-00e22861-718b-44cd-8ac9-ac6d5d189e94 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:58.222491 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-00e22861-718b-44cd-8ac9-ac6d5d189e94 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:58.224081 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-00e22861-718b-44cd-8ac9-ac6d5d189e94 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:58.225258 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-00e22861-718b-44cd-8ac9-ac6d5d189e94 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.155543 Jun 03 15:29:58.225818 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 240/468] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:58 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:29:59.077897 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ec6d37df-00f4-478a-bf18-936836ba6431 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:59.078502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ec6d37df-00f4-478a-bf18-936836ba6431 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:59.085244 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec6d37df-00f4-478a-bf18-936836ba6431 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:59.085690 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec6d37df-00f4-478a-bf18-936836ba6431 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:59.086468 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec6d37df-00f4-478a-bf18-936836ba6431 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:59.086921 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec6d37df-00f4-478a-bf18-936836ba6431 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:59.227422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ec6d37df-00f4-478a-bf18-936836ba6431 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:59.235914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ec6d37df-00f4-478a-bf18-936836ba6431 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.161809 Jun 03 15:29:59.236489 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 229/469] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:29:59 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:29:59.243359 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-574dd646-350a-45ac-a774-463a9620738e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:29:59.244151 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-574dd646-350a-45ac-a774-463a9620738e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:29:59.250935 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-574dd646-350a-45ac-a774-463a9620738e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:59.251383 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-574dd646-350a-45ac-a774-463a9620738e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:59.252182 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-574dd646-350a-45ac-a774-463a9620738e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:29:59.252638 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-574dd646-350a-45ac-a774-463a9620738e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:29:59.379177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-574dd646-350a-45ac-a774-463a9620738e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:59.387496 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-574dd646-350a-45ac-a774-463a9620738e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:59.388997 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-574dd646-350a-45ac-a774-463a9620738e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:29:59.390138 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-574dd646-350a-45ac-a774-463a9620738e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.151481 Jun 03 15:29:59.390730 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 241/470] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:29:59 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:30:00.253135 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5c87a26f-bc42-420b-ab32-141547e2e014 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:00.253820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5c87a26f-bc42-420b-ab32-141547e2e014 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:00.260317 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5c87a26f-bc42-420b-ab32-141547e2e014 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:00.260763 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5c87a26f-bc42-420b-ab32-141547e2e014 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:00.261517 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5c87a26f-bc42-420b-ab32-141547e2e014 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:00.261945 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5c87a26f-bc42-420b-ab32-141547e2e014 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:00.405092 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5c87a26f-bc42-420b-ab32-141547e2e014 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:00.411221 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b637f9bc-7818-4691-8cd7-5e18730c49ad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:00.412353 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b637f9bc-7818-4691-8cd7-5e18730c49ad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:00.414102 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5c87a26f-bc42-420b-ab32-141547e2e014 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.164728 Jun 03 15:30:00.415062 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 230/471] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:00 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:00.419311 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b637f9bc-7818-4691-8cd7-5e18730c49ad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:00.419758 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b637f9bc-7818-4691-8cd7-5e18730c49ad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:00.420566 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b637f9bc-7818-4691-8cd7-5e18730c49ad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:00.420996 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b637f9bc-7818-4691-8cd7-5e18730c49ad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:00.557522 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b637f9bc-7818-4691-8cd7-5e18730c49ad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:00.566376 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b637f9bc-7818-4691-8cd7-5e18730c49ad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:00.567921 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b637f9bc-7818-4691-8cd7-5e18730c49ad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:00.569074 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b637f9bc-7818-4691-8cd7-5e18730c49ad tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.163997 Jun 03 15:30:00.569642 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 242/472] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:30:00 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:30:01.431901 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e5091d7e-72ae-448f-a2be-9b73fe6682d8 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:01.432502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e5091d7e-72ae-448f-a2be-9b73fe6682d8 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:01.439030 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5091d7e-72ae-448f-a2be-9b73fe6682d8 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:01.439484 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5091d7e-72ae-448f-a2be-9b73fe6682d8 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:01.440242 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5091d7e-72ae-448f-a2be-9b73fe6682d8 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:01.440684 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5091d7e-72ae-448f-a2be-9b73fe6682d8 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:01.586292 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e5091d7e-72ae-448f-a2be-9b73fe6682d8 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:01.587920 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f8e98866-1610-4550-a9d4-b7d5eec62769 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:01.588529 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f8e98866-1610-4550-a9d4-b7d5eec62769 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:01.594402 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e5091d7e-72ae-448f-a2be-9b73fe6682d8 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.166372 Jun 03 15:30:01.595002 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 231/473] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:01 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:01.595154 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8e98866-1610-4550-a9d4-b7d5eec62769 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:01.595524 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8e98866-1610-4550-a9d4-b7d5eec62769 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:01.596282 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8e98866-1610-4550-a9d4-b7d5eec62769 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:01.596832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8e98866-1610-4550-a9d4-b7d5eec62769 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:01.724316 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f8e98866-1610-4550-a9d4-b7d5eec62769 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:01.732988 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f8e98866-1610-4550-a9d4-b7d5eec62769 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:01.735019 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f8e98866-1610-4550-a9d4-b7d5eec62769 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:01.736161 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f8e98866-1610-4550-a9d4-b7d5eec62769 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.152405 Jun 03 15:30:01.736711 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 243/474] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:30:01 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:30:02.611839 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6b54c44f-4d60-43e4-8cf5-cc1beae2b0a3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:02.612519 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6b54c44f-4d60-43e4-8cf5-cc1beae2b0a3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:02.619106 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6b54c44f-4d60-43e4-8cf5-cc1beae2b0a3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:02.619548 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6b54c44f-4d60-43e4-8cf5-cc1beae2b0a3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:02.620300 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6b54c44f-4d60-43e4-8cf5-cc1beae2b0a3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:02.620729 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6b54c44f-4d60-43e4-8cf5-cc1beae2b0a3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:02.755342 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3c340e64-7224-448a-a224-75fd5eaf0cf2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:02.755948 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3c340e64-7224-448a-a224-75fd5eaf0cf2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:02.761971 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3c340e64-7224-448a-a224-75fd5eaf0cf2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:02.762426 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3c340e64-7224-448a-a224-75fd5eaf0cf2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:02.763254 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3c340e64-7224-448a-a224-75fd5eaf0cf2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:02.763597 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6b54c44f-4d60-43e4-8cf5-cc1beae2b0a3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:02.763732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3c340e64-7224-448a-a224-75fd5eaf0cf2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:02.775185 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6b54c44f-4d60-43e4-8cf5-cc1beae2b0a3 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.166775 Jun 03 15:30:02.775849 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 232/475] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:02 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:02.894747 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3c340e64-7224-448a-a224-75fd5eaf0cf2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:02.903121 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3c340e64-7224-448a-a224-75fd5eaf0cf2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:02.904627 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3c340e64-7224-448a-a224-75fd5eaf0cf2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:02.905778 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3c340e64-7224-448a-a224-75fd5eaf0cf2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.155218 Jun 03 15:30:02.906354 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 244/476] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:30:02 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:30:03.793070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8a9211b4-2f4c-424d-be2f-44af32efcae1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:03.793680 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8a9211b4-2f4c-424d-be2f-44af32efcae1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:03.800852 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8a9211b4-2f4c-424d-be2f-44af32efcae1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:03.801301 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8a9211b4-2f4c-424d-be2f-44af32efcae1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:03.802065 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8a9211b4-2f4c-424d-be2f-44af32efcae1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:03.802502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8a9211b4-2f4c-424d-be2f-44af32efcae1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:03.924564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6f1269e6-2323-45a2-8440-4c30e96f17b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:03.925288 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6f1269e6-2323-45a2-8440-4c30e96f17b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:03.932984 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6f1269e6-2323-45a2-8440-4c30e96f17b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:03.933454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6f1269e6-2323-45a2-8440-4c30e96f17b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:03.934219 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6f1269e6-2323-45a2-8440-4c30e96f17b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:03.934683 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6f1269e6-2323-45a2-8440-4c30e96f17b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:03.948262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-8a9211b4-2f4c-424d-be2f-44af32efcae1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:03.956377 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8a9211b4-2f4c-424d-be2f-44af32efcae1 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.167114 Jun 03 15:30:03.957148 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 233/477] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:03 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:04.062103 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6f1269e6-2323-45a2-8440-4c30e96f17b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:04.071062 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6f1269e6-2323-45a2-8440-4c30e96f17b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:04.072554 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6f1269e6-2323-45a2-8440-4c30e96f17b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:04.073689 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6f1269e6-2323-45a2-8440-4c30e96f17b0 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.153547 Jun 03 15:30:04.074237 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 245/478] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:30:03 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:30:04.973670 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3cca7fdd-40a0-4fd1-8466-5f355363ceed tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:04.974286 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3cca7fdd-40a0-4fd1-8466-5f355363ceed tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:04.980931 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3cca7fdd-40a0-4fd1-8466-5f355363ceed tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:04.981381 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3cca7fdd-40a0-4fd1-8466-5f355363ceed tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:04.982147 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3cca7fdd-40a0-4fd1-8466-5f355363ceed tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:04.982619 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3cca7fdd-40a0-4fd1-8466-5f355363ceed tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:05.091681 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-18c07678-4341-4ba7-9121-d23ab17e0364 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:05.092396 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-18c07678-4341-4ba7-9121-d23ab17e0364 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:05.099986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-18c07678-4341-4ba7-9121-d23ab17e0364 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:05.100571 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-18c07678-4341-4ba7-9121-d23ab17e0364 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:05.101584 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-18c07678-4341-4ba7-9121-d23ab17e0364 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:05.102125 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-18c07678-4341-4ba7-9121-d23ab17e0364 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:05.131454 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3cca7fdd-40a0-4fd1-8466-5f355363ceed tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:05.140355 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3cca7fdd-40a0-4fd1-8466-5f355363ceed tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.170461 Jun 03 15:30:05.142078 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 234/479] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:04 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:05.240590 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-18c07678-4341-4ba7-9121-d23ab17e0364 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:05.249109 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-18c07678-4341-4ba7-9121-d23ab17e0364 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:05.251160 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-18c07678-4341-4ba7-9121-d23ab17e0364 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:05.252302 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-18c07678-4341-4ba7-9121-d23ab17e0364 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.164522 Jun 03 15:30:05.252858 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 246/480] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:30:05 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:30:06.159396 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3777c8dd-6f48-4a87-b0f7-15a941ad37eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:06.160001 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3777c8dd-6f48-4a87-b0f7-15a941ad37eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:06.166727 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3777c8dd-6f48-4a87-b0f7-15a941ad37eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:06.167178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3777c8dd-6f48-4a87-b0f7-15a941ad37eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:06.167941 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3777c8dd-6f48-4a87-b0f7-15a941ad37eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:06.168377 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3777c8dd-6f48-4a87-b0f7-15a941ad37eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:06.183422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=100 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:06.270691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-00e8cc93-4be1-4905-9358-4e4ac6bd9a95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:06.271381 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-00e8cc93-4be1-4905-9358-4e4ac6bd9a95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:06.277860 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-00e8cc93-4be1-4905-9358-4e4ac6bd9a95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:06.278375 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-00e8cc93-4be1-4905-9358-4e4ac6bd9a95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:06.279230 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-00e8cc93-4be1-4905-9358-4e4ac6bd9a95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:06.279749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-00e8cc93-4be1-4905-9358-4e4ac6bd9a95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:06.314058 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3777c8dd-6f48-4a87-b0f7-15a941ad37eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:06.322200 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3777c8dd-6f48-4a87-b0f7-15a941ad37eb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.167268 Jun 03 15:30:06.323017 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 235/481] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:06 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:06.412588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-00e8cc93-4be1-4905-9358-4e4ac6bd9a95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:06.420827 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-00e8cc93-4be1-4905-9358-4e4ac6bd9a95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:06.422348 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-00e8cc93-4be1-4905-9358-4e4ac6bd9a95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:06.423518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-00e8cc93-4be1-4905-9358-4e4ac6bd9a95 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.156982 Jun 03 15:30:06.424074 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 247/482] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:30:06 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:30:07.185576 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-193a6c39-1c1d-4848-9818-0e78c8a07888 req-c817d765-272e-4844-bb8a-36a05ba39ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123dc0c-78c6-44ce-b847-927843a3751c", "name": "network-vif-plugged", "status": "completed", "tag": "d065a51d-4c7e-482f-87f7-74c4d679a6c1"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:07.195162 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-193a6c39-1c1d-4848-9818-0e78c8a07888 req-c817d765-272e-4844-bb8a-36a05ba39ae8 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:07.195574 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-193a6c39-1c1d-4848-9818-0e78c8a07888 req-c817d765-272e-4844-bb8a-36a05ba39ae8 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:07.207149 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-193a6c39-1c1d-4848-9818-0e78c8a07888 req-c817d765-272e-4844-bb8a-36a05ba39ae8 service nova] Creating event network-vif-plugged:d065a51d-4c7e-482f-87f7-74c4d679a6c1 for instance e123dc0c-78c6-44ce-b847-927843a3751c on hv-cinder-83124 Jun 03 15:30:07.214195 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-193a6c39-1c1d-4848-9818-0e78c8a07888 req-c817d765-272e-4844-bb8a-36a05ba39ae8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032229 Jun 03 15:30:07.215277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 236/483] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:30:07.340079 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d9eb5856-46e6-4033-9f66-2b7ed0c55eb2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:07.340606 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d9eb5856-46e6-4033-9f66-2b7ed0c55eb2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:07.347242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d9eb5856-46e6-4033-9f66-2b7ed0c55eb2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:07.347682 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d9eb5856-46e6-4033-9f66-2b7ed0c55eb2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:07.348437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d9eb5856-46e6-4033-9f66-2b7ed0c55eb2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:07.348861 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d9eb5856-46e6-4033-9f66-2b7ed0c55eb2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:07.442360 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a8331991-de61-4b10-a449-bd39428384d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:07.443196 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a8331991-de61-4b10-a449-bd39428384d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:07.449521 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8331991-de61-4b10-a449-bd39428384d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:07.450054 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8331991-de61-4b10-a449-bd39428384d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:07.450928 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8331991-de61-4b10-a449-bd39428384d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:07.451446 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a8331991-de61-4b10-a449-bd39428384d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:07.491370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d9eb5856-46e6-4033-9f66-2b7ed0c55eb2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:07.499379 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d9eb5856-46e6-4033-9f66-2b7ed0c55eb2 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.163186 Jun 03 15:30:07.500087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 248/484] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:07 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:07.585719 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a8331991-de61-4b10-a449-bd39428384d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:07.594887 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a8331991-de61-4b10-a449-bd39428384d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:07.596380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a8331991-de61-4b10-a449-bd39428384d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:07.597548 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a8331991-de61-4b10-a449-bd39428384d5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.159920 Jun 03 15:30:07.598123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 237/485] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:30:07 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:30:08.515566 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ac1431f3-7211-42d1-ae0c-bb93c5067cf7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:08.516133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ac1431f3-7211-42d1-ae0c-bb93c5067cf7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:08.523579 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ac1431f3-7211-42d1-ae0c-bb93c5067cf7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:08.524024 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ac1431f3-7211-42d1-ae0c-bb93c5067cf7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:08.524777 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ac1431f3-7211-42d1-ae0c-bb93c5067cf7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:08.525207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ac1431f3-7211-42d1-ae0c-bb93c5067cf7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:08.617004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4b57900b-93d0-4fd2-a157-84788ca5ff55 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:08.617977 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4b57900b-93d0-4fd2-a157-84788ca5ff55 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:08.627687 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b57900b-93d0-4fd2-a157-84788ca5ff55 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:08.628134 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b57900b-93d0-4fd2-a157-84788ca5ff55 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:08.628901 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b57900b-93d0-4fd2-a157-84788ca5ff55 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:08.629330 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4b57900b-93d0-4fd2-a157-84788ca5ff55 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:08.671194 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ac1431f3-7211-42d1-ae0c-bb93c5067cf7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:08.680309 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ac1431f3-7211-42d1-ae0c-bb93c5067cf7 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.168525 Jun 03 15:30:08.680979 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 249/486] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:08 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:30:08.758319 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4b57900b-93d0-4fd2-a157-84788ca5ff55 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:08.766812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4b57900b-93d0-4fd2-a157-84788ca5ff55 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:08.768515 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4b57900b-93d0-4fd2-a157-84788ca5ff55 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:08.769648 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4b57900b-93d0-4fd2-a157-84788ca5ff55 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.157482 Jun 03 15:30:08.770198 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 238/487] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:30:08 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:30:09.698328 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6e5b0aca-3bc2-46b6-b441-e1690141d6c4 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:09.699070 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6e5b0aca-3bc2-46b6-b441-e1690141d6c4 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:09.706614 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e5b0aca-3bc2-46b6-b441-e1690141d6c4 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:09.707066 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e5b0aca-3bc2-46b6-b441-e1690141d6c4 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:09.707829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e5b0aca-3bc2-46b6-b441-e1690141d6c4 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:09.708261 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6e5b0aca-3bc2-46b6-b441-e1690141d6c4 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:09.787856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c2c832cd-563f-4203-8b31-da05e210e4f1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:09.788314 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c2c832cd-563f-4203-8b31-da05e210e4f1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:09.795904 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2c832cd-563f-4203-8b31-da05e210e4f1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:09.796359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2c832cd-563f-4203-8b31-da05e210e4f1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:09.797178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2c832cd-563f-4203-8b31-da05e210e4f1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:09.797619 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2c832cd-563f-4203-8b31-da05e210e4f1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:09.867791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6e5b0aca-3bc2-46b6-b441-e1690141d6c4 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:09.875986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6e5b0aca-3bc2-46b6-b441-e1690141d6c4 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.181489 Jun 03 15:30:09.876754 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 250/488] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:09 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:10.158920 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c2c832cd-563f-4203-8b31-da05e210e4f1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:10.167368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c2c832cd-563f-4203-8b31-da05e210e4f1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:10.168884 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c2c832cd-563f-4203-8b31-da05e210e4f1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:10.170069 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c2c832cd-563f-4203-8b31-da05e210e4f1 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1808 microversion: 2.20 time: 0.386361 Jun 03 15:30:10.170645 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 239/489] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:30:09 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1808 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:30:10.897448 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-390aa193-7224-4fd7-9c59-20f0efab25c6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:10.898026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-390aa193-7224-4fd7-9c59-20f0efab25c6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:10.904503 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-390aa193-7224-4fd7-9c59-20f0efab25c6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:10.904944 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-390aa193-7224-4fd7-9c59-20f0efab25c6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:10.905693 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-390aa193-7224-4fd7-9c59-20f0efab25c6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:10.906815 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-390aa193-7224-4fd7-9c59-20f0efab25c6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:11.049016 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-390aa193-7224-4fd7-9c59-20f0efab25c6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:11.057840 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-390aa193-7224-4fd7-9c59-20f0efab25c6 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.164340 Jun 03 15:30:11.058622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 251/490] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:10 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:11.189549 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7482a9ea-3d46-48dd-ac90-3d2e406731d8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:11.190244 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7482a9ea-3d46-48dd-ac90-3d2e406731d8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:11.196894 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7482a9ea-3d46-48dd-ac90-3d2e406731d8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:11.197340 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7482a9ea-3d46-48dd-ac90-3d2e406731d8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:11.198107 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7482a9ea-3d46-48dd-ac90-3d2e406731d8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:11.198556 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7482a9ea-3d46-48dd-ac90-3d2e406731d8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:11.330401 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7482a9ea-3d46-48dd-ac90-3d2e406731d8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:11.338996 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7482a9ea-3d46-48dd-ac90-3d2e406731d8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:11.340507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7482a9ea-3d46-48dd-ac90-3d2e406731d8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:11.341661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7482a9ea-3d46-48dd-ac90-3d2e406731d8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1795 microversion: 2.20 time: 0.156621 Jun 03 15:30:11.342219 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 240/491] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:30:11 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1795 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:30:12.075903 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-aae4c628-65fc-4ead-8f14-dc2db73e1ead tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:12.076478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-aae4c628-65fc-4ead-8f14-dc2db73e1ead tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:12.083000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aae4c628-65fc-4ead-8f14-dc2db73e1ead tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:12.083423 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aae4c628-65fc-4ead-8f14-dc2db73e1ead tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:12.084177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aae4c628-65fc-4ead-8f14-dc2db73e1ead tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:12.084612 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aae4c628-65fc-4ead-8f14-dc2db73e1ead tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:12.226018 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-aae4c628-65fc-4ead-8f14-dc2db73e1ead tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:12.233978 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-aae4c628-65fc-4ead-8f14-dc2db73e1ead tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.162012 Jun 03 15:30:12.234557 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 252/492] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:12 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:13.251023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-bf1b74a0-4b45-42f4-89cf-343da85ef16e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:13.251555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-bf1b74a0-4b45-42f4-89cf-343da85ef16e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:13.258873 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bf1b74a0-4b45-42f4-89cf-343da85ef16e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:13.259321 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bf1b74a0-4b45-42f4-89cf-343da85ef16e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:13.260077 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bf1b74a0-4b45-42f4-89cf-343da85ef16e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:13.260507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bf1b74a0-4b45-42f4-89cf-343da85ef16e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:13.404410 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-bf1b74a0-4b45-42f4-89cf-343da85ef16e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:13.412589 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-bf1b74a0-4b45-42f4-89cf-343da85ef16e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1755 microversion: 2.1 time: 0.165429 Jun 03 15:30:13.413150 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 241/493] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:13 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:14.429595 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-af3ee294-8b96-46a5-9705-bd4ca6857168 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:14.430203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-af3ee294-8b96-46a5-9705-bd4ca6857168 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:14.436860 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-af3ee294-8b96-46a5-9705-bd4ca6857168 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:14.437393 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-af3ee294-8b96-46a5-9705-bd4ca6857168 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:14.438158 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-af3ee294-8b96-46a5-9705-bd4ca6857168 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:14.438610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-af3ee294-8b96-46a5-9705-bd4ca6857168 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:14.582024 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-af3ee294-8b96-46a5-9705-bd4ca6857168 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:14.590328 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-af3ee294-8b96-46a5-9705-bd4ca6857168 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1758 microversion: 2.1 time: 0.164554 Jun 03 15:30:14.590924 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 253/494] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:14 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:21.208671 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1a4a4e7d-8009-417e-911f-651d23c58bd2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:21.209271 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1a4a4e7d-8009-417e-911f-651d23c58bd2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:21.211859 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=40 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:21.217272 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1a4a4e7d-8009-417e-911f-651d23c58bd2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:21.217729 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1a4a4e7d-8009-417e-911f-651d23c58bd2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:21.218509 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1a4a4e7d-8009-417e-911f-651d23c58bd2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:21.219580 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1a4a4e7d-8009-417e-911f-651d23c58bd2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:21.242229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1a4a4e7d-8009-417e-911f-651d23c58bd2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2/ips" status: 200 len: 151 microversion: 2.1 time: 0.037435 Jun 03 15:30:21.243215 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 242/495] 10.222.0.93 () {58 vars in 1247 bytes} [Fri Jun 3 15:30:21 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:30:21.253232 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ee989b33-e0f7-49c8-abd4-97b4df5ef76e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "382bff78-a0d7-4f57-a223-b258872078c2"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:21.254300 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ee989b33-e0f7-49c8-abd4-97b4df5ef76e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:21.256478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=42 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:21.261963 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee989b33-e0f7-49c8-abd4-97b4df5ef76e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:21.262415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee989b33-e0f7-49c8-abd4-97b4df5ef76e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:21.263224 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee989b33-e0f7-49c8-abd4-97b4df5ef76e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:21.263663 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ee989b33-e0f7-49c8-abd4-97b4df5ef76e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:21.350052 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-ee989b33-e0f7-49c8-abd4-97b4df5ef76e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Invalid volume: volume 382bff78-a0d7-4f57-a223-b258872078c2 is already attached to instances: f9be206f-1554-46fe-9fa7-581d2d394865 Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ee989b33-e0f7-49c8-abd4-97b4df5ef76e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: POST /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2/os-volume_attachments HTTP/1.1 Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 74 Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:30:21.351772 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {"volumeAttachment": {"volumeId": "382bff78-a0d7-4f57-a223-b258872078c2"}} Jun 03 15:30:21.353209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Invalid volume: volume 382bff78-a0d7-4f57-a223-b258872078c2 is already attached to instances: f9be206f-1554-46fe-9fa7-581d2d394865 Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'server_id': 'fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2', 'body': {'volumeAttachment': {'volumeId': '382bff78-a0d7-4f57-a223-b258872078c2'}}} Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 382bff78-a0d7-4f57-a223-b258872078c2 is already attached to instances: f9be206f-1554-46fe-9fa7-581d2d394865 Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:30:21.354037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 382bff78-a0d7-4f57-a223-b258872078c2 is already attached to instances: f9be206f-1554-46fe-9fa7-581d2d394865 Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:30:21.355327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:30:21.356519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:30:21.356519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:30:21.356519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:30:21.356519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 382bff78-a0d7-4f57-a223-b258872078c2 is already attached to instances: f9be206f-1554-46fe-9fa7-581d2d394865 Jun 03 15:30:21.356519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:30:21.356519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ee989b33-e0f7-49c8-abd4-97b4df5ef76e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 400 to user: Invalid volume: volume 382bff78-a0d7-4f57-a223-b258872078c2 is already attached to instances: f9be206f-1554-46fe-9fa7-581d2d394865 {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:30:21.356519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ee989b33-e0f7-49c8-abd4-97b4df5ef76e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104026 Jun 03 15:30:21.356519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 254/496] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:30:21 2022] POST /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:30:21.362030 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-105da48d-c69e-4b0d-8382-a4f464e95047 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:21.362565 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-105da48d-c69e-4b0d-8382-a4f464e95047 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:21.372775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-105da48d-c69e-4b0d-8382-a4f464e95047 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:21.373226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-105da48d-c69e-4b0d-8382-a4f464e95047 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:21.373983 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-105da48d-c69e-4b0d-8382-a4f464e95047 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:21.374416 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-105da48d-c69e-4b0d-8382-a4f464e95047 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:21.401605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-105da48d-c69e-4b0d-8382-a4f464e95047 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:30:21.480747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-105da48d-c69e-4b0d-8382-a4f464e95047 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 204 len: 0 microversion: 2.1 time: 0.122102 Jun 03 15:30:21.481232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 243/497] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:30:21 2022] DELETE /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:30:21.489338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-61c1d579-c9e4-4ca4-90f2-40706e3e4ef6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:21.490094 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-61c1d579-c9e4-4ca4-90f2-40706e3e4ef6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:21.497704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-61c1d579-c9e4-4ca4-90f2-40706e3e4ef6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:21.498203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-61c1d579-c9e4-4ca4-90f2-40706e3e4ef6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:21.498997 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-61c1d579-c9e4-4ca4-90f2-40706e3e4ef6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:21.499434 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-61c1d579-c9e4-4ca4-90f2-40706e3e4ef6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:21.638554 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-61c1d579-c9e4-4ca4-90f2-40706e3e4ef6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:21.647233 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-61c1d579-c9e4-4ca4-90f2-40706e3e4ef6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1682 microversion: 2.1 time: 0.161661 Jun 03 15:30:21.647819 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 255/498] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:21 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:22.664700 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6df2b42f-0bc9-43b7-9cfb-1b056f0ec755 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:22.665402 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6df2b42f-0bc9-43b7-9cfb-1b056f0ec755 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:22.671666 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6df2b42f-0bc9-43b7-9cfb-1b056f0ec755 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:22.672117 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6df2b42f-0bc9-43b7-9cfb-1b056f0ec755 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:22.672895 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6df2b42f-0bc9-43b7-9cfb-1b056f0ec755 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:22.673329 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6df2b42f-0bc9-43b7-9cfb-1b056f0ec755 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:22.805326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6df2b42f-0bc9-43b7-9cfb-1b056f0ec755 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:22.812859 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6df2b42f-0bc9-43b7-9cfb-1b056f0ec755 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1682 microversion: 2.1 time: 0.152456 Jun 03 15:30:22.813430 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 244/499] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:22 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:23.831250 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-200e0cea-86c6-4af1-8f9c-7710395b594f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:23.831877 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-200e0cea-86c6-4af1-8f9c-7710395b594f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:23.838429 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-200e0cea-86c6-4af1-8f9c-7710395b594f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:23.838909 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-200e0cea-86c6-4af1-8f9c-7710395b594f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:23.839700 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-200e0cea-86c6-4af1-8f9c-7710395b594f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:23.840112 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-200e0cea-86c6-4af1-8f9c-7710395b594f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:23.857092 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=100 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:23.976639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-200e0cea-86c6-4af1-8f9c-7710395b594f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:23.984516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-200e0cea-86c6-4af1-8f9c-7710395b594f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1682 microversion: 2.1 time: 0.157171 Jun 03 15:30:23.986095 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 256/500] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:23 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:24.345646 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-d83d66b7-efd7-47d1-b110-e3df380b2d23 req-f7f13756-6943-4065-a1f1-592e49baa302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2", "name": "network-vif-deleted", "tag": "343d88d0-4f0d-4021-bfee-efee56348782"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:24.357259 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-d83d66b7-efd7-47d1-b110-e3df380b2d23 req-f7f13756-6943-4065-a1f1-592e49baa302 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:24.357639 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-d83d66b7-efd7-47d1-b110-e3df380b2d23 req-f7f13756-6943-4065-a1f1-592e49baa302 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:24.371470 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-d83d66b7-efd7-47d1-b110-e3df380b2d23 req-f7f13756-6943-4065-a1f1-592e49baa302 service nova] Creating event network-vif-deleted:343d88d0-4f0d-4021-bfee-efee56348782 for instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 on hv-cinder-83124 Jun 03 15:30:24.377795 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-d83d66b7-efd7-47d1-b110-e3df380b2d23 req-f7f13756-6943-4065-a1f1-592e49baa302 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036618 Jun 03 15:30:24.378375 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 245/501] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:30:25.004285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:25.005502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:25.019380 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:25.021197 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:25.023826 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:25.024598 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:25.071420 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:25.072107 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:25.072632 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lazy-loading 'fault' on Instance uuid fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:30:25.120144 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:25.129371 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b0b59672-3e91-463e-b656-7b29953fefb1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 200 len: 1331 microversion: 2.1 time: 0.130468 Jun 03 15:30:25.129938 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 257/502] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:24 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:26.148827 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b2913b1f-38ae-4a95-99a0-3485f7ca38d8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:26.150136 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b2913b1f-38ae-4a95-99a0-3485f7ca38d8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:26.156786 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b2913b1f-38ae-4a95-99a0-3485f7ca38d8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:26.157240 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b2913b1f-38ae-4a95-99a0-3485f7ca38d8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:26.158008 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b2913b1f-38ae-4a95-99a0-3485f7ca38d8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:26.158653 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b2913b1f-38ae-4a95-99a0-3485f7ca38d8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:26.172101 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-b2913b1f-38ae-4a95-99a0-3485f7ca38d8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b2913b1f-38ae-4a95-99a0-3485f7ca38d8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 HTTP/1.1 Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:30:26.173743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:30:26.175347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': 'fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2'} Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:30:26.179457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:30:26.180970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:30:26.182267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b2913b1f-38ae-4a95-99a0-3485f7ca38d8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:30:26.182267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b2913b1f-38ae-4a95-99a0-3485f7ca38d8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 404 len: 111 microversion: 2.1 time: 0.031178 Jun 03 15:30:26.182267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 246/503] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:26 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:30:26.185917 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d8e3f5d4-802c-45c3-a77c-e48dd0f2518d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '.version_select at 0x7f92f0bcc4c0>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:26.205769 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d8e3f5d4-802c-45c3-a77c-e48dd0f2518d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-919929934" status: 202 len: 0 microversion: 2.1 time: 0.024435 Jun 03 15:30:26.206788 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 258/504] 10.222.0.93 () {58 vars in 1217 bytes} [Fri Jun 3 15:30:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-919929934 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:30:26.912849 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-470dc615-3a23-475f-a928-5d9ebb257cf7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:26.913341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-470dc615-3a23-475f-a928-5d9ebb257cf7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:26.919652 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-470dc615-3a23-475f-a928-5d9ebb257cf7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:26.920107 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-470dc615-3a23-475f-a928-5d9ebb257cf7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:26.920882 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-470dc615-3a23-475f-a928-5d9ebb257cf7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:26.921321 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-470dc615-3a23-475f-a928-5d9ebb257cf7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:27.060703 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-470dc615-3a23-475f-a928-5d9ebb257cf7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lazy-loading 'services' on Instance uuid f9be206f-1554-46fe-9fa7-581d2d394865 {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:30:27.177826 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-470dc615-3a23-475f-a928-5d9ebb257cf7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/os-volume_attachments/382bff78-a0d7-4f57-a223-b258872078c2" status: 202 len: 0 microversion: 2.1 time: 0.268793 Jun 03 15:30:27.178431 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 247/505] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:30:26 2022] DELETE /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/os-volume_attachments/382bff78-a0d7-4f57-a223-b258872078c2 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:30:27.190501 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2a0ee82b-5a5d-4cbc-9393-cdf3129fa36f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:27.191489 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2a0ee82b-5a5d-4cbc-9393-cdf3129fa36f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:27.198973 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a0ee82b-5a5d-4cbc-9393-cdf3129fa36f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:27.199456 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a0ee82b-5a5d-4cbc-9393-cdf3129fa36f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:27.200386 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a0ee82b-5a5d-4cbc-9393-cdf3129fa36f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:27.201460 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2a0ee82b-5a5d-4cbc-9393-cdf3129fa36f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:27.234136 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2a0ee82b-5a5d-4cbc-9393-cdf3129fa36f tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051150 Jun 03 15:30:27.234720 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 259/506] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:30:27 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:30:28.246451 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-43a78b11-828d-4632-889c-5f8504a71b1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:28.247663 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-43a78b11-828d-4632-889c-5f8504a71b1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:28.254255 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-43a78b11-828d-4632-889c-5f8504a71b1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:28.254740 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-43a78b11-828d-4632-889c-5f8504a71b1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:28.255523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-43a78b11-828d-4632-889c-5f8504a71b1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:28.255967 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-43a78b11-828d-4632-889c-5f8504a71b1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:28.286114 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-43a78b11-828d-4632-889c-5f8504a71b1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044455 Jun 03 15:30:28.286693 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 248/507] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:30:28 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 15:30:28.343135 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-13508030-58ad-4b4d-b49c-55c9f7741b09 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:28.343621 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-13508030-58ad-4b4d-b49c-55c9f7741b09 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:28.350609 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-13508030-58ad-4b4d-b49c-55c9f7741b09 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:28.351062 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-13508030-58ad-4b4d-b49c-55c9f7741b09 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:28.351834 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-13508030-58ad-4b4d-b49c-55c9f7741b09 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:28.352271 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-13508030-58ad-4b4d-b49c-55c9f7741b09 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:28.377507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-13508030-58ad-4b4d-b49c-55c9f7741b09 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Going to try to terminate instance {{(pid=117806) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:30:28.459620 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-13508030-58ad-4b4d-b49c-55c9f7741b09 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 204 len: 0 microversion: 2.1 time: 0.119947 Jun 03 15:30:28.460570 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 260/508] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:30:28 2022] DELETE /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:30:28.470998 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3963abc7-e5f0-4960-ab21-1638a07ddbb8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:28.471605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3963abc7-e5f0-4960-ab21-1638a07ddbb8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:28.477667 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3963abc7-e5f0-4960-ab21-1638a07ddbb8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:28.478056 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3963abc7-e5f0-4960-ab21-1638a07ddbb8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:28.478871 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3963abc7-e5f0-4960-ab21-1638a07ddbb8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:28.479301 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3963abc7-e5f0-4960-ab21-1638a07ddbb8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:28.609407 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3963abc7-e5f0-4960-ab21-1638a07ddbb8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:28.617522 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3963abc7-e5f0-4960-ab21-1638a07ddbb8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1682 microversion: 2.1 time: 0.152392 Jun 03 15:30:28.618104 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 249/509] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:28 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:29.228026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7aea8663-4d21-46d2-a4e4-80b8206bb326 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:29.228619 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7aea8663-4d21-46d2-a4e4-80b8206bb326 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:29.234662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7aea8663-4d21-46d2-a4e4-80b8206bb326 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:29.235111 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7aea8663-4d21-46d2-a4e4-80b8206bb326 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:29.235875 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7aea8663-4d21-46d2-a4e4-80b8206bb326 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:29.236313 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7aea8663-4d21-46d2-a4e4-80b8206bb326 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:29.361900 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-7aea8663-4d21-46d2-a4e4-80b8206bb326 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lazy-loading 'services' on Instance uuid ce808322-3f17-4d8f-8d33-909ecba99d7a {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:30:29.474922 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7aea8663-4d21-46d2-a4e4-80b8206bb326 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/os-volume_attachments/baf71ae5-f0f6-45bb-bb53-48b42385e465" status: 202 len: 0 microversion: 2.1 time: 0.250908 Jun 03 15:30:29.475582 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 261/510] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:30:29 2022] DELETE /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/os-volume_attachments/baf71ae5-f0f6-45bb-bb53-48b42385e465 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:30:29.636533 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d61ddd55-33c9-479c-a88e-5c3ff71aecc4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:29.637225 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d61ddd55-33c9-479c-a88e-5c3ff71aecc4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:29.644053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d61ddd55-33c9-479c-a88e-5c3ff71aecc4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:29.644499 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d61ddd55-33c9-479c-a88e-5c3ff71aecc4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:29.645281 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d61ddd55-33c9-479c-a88e-5c3ff71aecc4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:29.645716 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d61ddd55-33c9-479c-a88e-5c3ff71aecc4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:29.783091 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d61ddd55-33c9-479c-a88e-5c3ff71aecc4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:29.790788 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d61ddd55-33c9-479c-a88e-5c3ff71aecc4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1682 microversion: 2.1 time: 0.159383 Jun 03 15:30:29.791356 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 250/511] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:29 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:30.810579 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-759497ef-db1f-43d0-b6e3-76006d2185b4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:30.811579 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-759497ef-db1f-43d0-b6e3-76006d2185b4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:30.832248 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-759497ef-db1f-43d0-b6e3-76006d2185b4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:30.832713 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-759497ef-db1f-43d0-b6e3-76006d2185b4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:30.833512 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-759497ef-db1f-43d0-b6e3-76006d2185b4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:30.833946 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-759497ef-db1f-43d0-b6e3-76006d2185b4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:30.973153 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-759497ef-db1f-43d0-b6e3-76006d2185b4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:30.981552 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-759497ef-db1f-43d0-b6e3-76006d2185b4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1682 microversion: 2.1 time: 0.176896 Jun 03 15:30:30.982192 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 262/512] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:30 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:31.639482 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-eaa81f49-95f8-46c4-ab9f-e756363fff96 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:31.646346 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eaa81f49-95f8-46c4-ab9f-e756363fff96 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:31.646840 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eaa81f49-95f8-46c4-ab9f-e756363fff96 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:31.670745 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-eaa81f49-95f8-46c4-ab9f-e756363fff96 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Going to try to stop instance {{(pid=117805) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 15:30:31.696213 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:31.732791 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-eaa81f49-95f8-46c4-ab9f-e756363fff96 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/action" status: 202 len: 0 microversion: 2.1 time: 0.096914 Jun 03 15:30:31.735510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-af6085ca-9def-427c-a770-988adda79573 req-646506a0-1316-43f3-8932-e92f202bcc06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9be206f-1554-46fe-9fa7-581d2d394865", "name": "network-vif-deleted", "tag": "67597138-621c-43e8-af88-f2fa1bf44d03"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:31.737235 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 251/513] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:30:31 2022] POST /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:30:31.743023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-18b7d042-176c-436a-8e7a-767fcdfff9e7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:31.743911 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-18b7d042-176c-436a-8e7a-767fcdfff9e7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:31.750978 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-18b7d042-176c-436a-8e7a-767fcdfff9e7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:31.752532 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-18b7d042-176c-436a-8e7a-767fcdfff9e7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:31.753895 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-18b7d042-176c-436a-8e7a-767fcdfff9e7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:31.754683 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-18b7d042-176c-436a-8e7a-767fcdfff9e7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:31.761797 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-af6085ca-9def-427c-a770-988adda79573 req-646506a0-1316-43f3-8932-e92f202bcc06 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:31.762252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-af6085ca-9def-427c-a770-988adda79573 req-646506a0-1316-43f3-8932-e92f202bcc06 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:31.782410 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-af6085ca-9def-427c-a770-988adda79573 req-646506a0-1316-43f3-8932-e92f202bcc06 service nova] Creating event network-vif-deleted:67597138-621c-43e8-af88-f2fa1bf44d03 for instance f9be206f-1554-46fe-9fa7-581d2d394865 on hv-cinder-83124 Jun 03 15:30:31.790392 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-af6085ca-9def-427c-a770-988adda79573 req-646506a0-1316-43f3-8932-e92f202bcc06 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064621 Jun 03 15:30:31.791396 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 263/514] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:30:31.949984 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-18b7d042-176c-436a-8e7a-767fcdfff9e7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:31.958740 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-18b7d042-176c-436a-8e7a-767fcdfff9e7 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1676 microversion: 2.1 time: 0.220062 Jun 03 15:30:31.959768 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 252/515] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:31 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:32.000423 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:32.002344 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:32.008932 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:32.009389 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:32.010320 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:32.010798 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:32.044250 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:32.044705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:32.045167 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lazy-loading 'fault' on Instance uuid f9be206f-1554-46fe-9fa7-581d2d394865 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:30:32.089132 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:32.097324 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4af76ed2-6a0c-4157-af96-2c5a6a8b9839 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 200 len: 1332 microversion: 2.1 time: 0.101897 Jun 03 15:30:32.097906 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 264/516] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:31 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:32.976786 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-18907fa2-ca01-4edd-8b5f-93482d62ab0d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:32.977398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-18907fa2-ca01-4edd-8b5f-93482d62ab0d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:32.983992 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-18907fa2-ca01-4edd-8b5f-93482d62ab0d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:32.984451 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-18907fa2-ca01-4edd-8b5f-93482d62ab0d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:32.985219 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-18907fa2-ca01-4edd-8b5f-93482d62ab0d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:32.985668 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-18907fa2-ca01-4edd-8b5f-93482d62ab0d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:33.117807 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3258909b-c4a5-4528-9f9f-bcdfabaf3629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:33.118329 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-18907fa2-ca01-4edd-8b5f-93482d62ab0d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:33.118812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3258909b-c4a5-4528-9f9f-bcdfabaf3629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:33.125402 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-18907fa2-ca01-4edd-8b5f-93482d62ab0d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1676 microversion: 2.1 time: 0.152486 Jun 03 15:30:33.125815 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3258909b-c4a5-4528-9f9f-bcdfabaf3629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:33.125976 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 253/517] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:32 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:33.127152 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3258909b-c4a5-4528-9f9f-bcdfabaf3629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:33.128176 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3258909b-c4a5-4528-9f9f-bcdfabaf3629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:33.128619 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3258909b-c4a5-4528-9f9f-bcdfabaf3629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:33.143933 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-3258909b-c4a5-4528-9f9f-bcdfabaf3629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3258909b-c4a5-4528-9f9f-bcdfabaf3629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 HTTP/1.1 Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:30:33.146178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:30:33.147608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'f9be206f-1554-46fe-9fa7-581d2d394865'} Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:30:33.148343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:30:33.149513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:30:33.151101 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3258909b-c4a5-4528-9f9f-bcdfabaf3629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:30:33.151101 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3258909b-c4a5-4528-9f9f-bcdfabaf3629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 404 len: 111 microversion: 2.1 time: 0.037183 Jun 03 15:30:33.151101 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 265/518] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:33 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:30:33.157709 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9f1aefb5-40e8-45a2-b27b-f439a2ec7231 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '.version_select at 0x7f92f0c305e0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:33.177776 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9f1aefb5-40e8-45a2-b27b-f439a2ec7231 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875216572" status: 202 len: 0 microversion: 2.1 time: 0.023858 Jun 03 15:30:33.178341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 254/519] 10.222.0.93 () {58 vars in 1220 bytes} [Fri Jun 3 15:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875216572 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:30:33.823652 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7b431f6d-b733-4741-8995-632c179e2394 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: .version_select at 0x7f92f0b0f310>, body: {"keypair": {"name": "tempest-keypair-83876481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYlJyN/7Bzk0+caJHzl0khqlbC2mv1NWvHN4c+7i2pEptoJX29mLlQxqsQNJK3LqmPaOZdPNvM2Y4y7NR68DVPgbG8SiU3qALLoSH6Pc2oNjo7oedK2rcHdW6fM41F0yA=="}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:33.837992 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-7b431f6d-b733-4741-8995-632c179e2394 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:30:33.841796 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-7b431f6d-b733-4741-8995-632c179e2394 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for user 193a35a91a47410f8b12cb2e84b33e1f and project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:30:33.863906 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7b431f6d-b733-4741-8995-632c179e2394 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044096 Jun 03 15:30:33.864501 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 266/520] 10.222.0.93 () {60 vars in 1158 bytes} [Fri Jun 3 15:30:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:30:34.144846 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-23522821-0d2c-434c-8a39-46fbcbdfb175 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:34.145527 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-23522821-0d2c-434c-8a39-46fbcbdfb175 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:34.154845 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-23522821-0d2c-434c-8a39-46fbcbdfb175 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:34.155319 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-23522821-0d2c-434c-8a39-46fbcbdfb175 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:34.156098 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-23522821-0d2c-434c-8a39-46fbcbdfb175 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:34.156542 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-23522821-0d2c-434c-8a39-46fbcbdfb175 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:34.549722 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-23522821-0d2c-434c-8a39-46fbcbdfb175 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:34.557529 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-23522821-0d2c-434c-8a39-46fbcbdfb175 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1676 microversion: 2.1 time: 0.418641 Jun 03 15:30:34.558119 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 255/521] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:34 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1676 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:35.083019 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a62b7f18-470a-4295-88ea-17b7b4dcfe36 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "211032b0-631a-4e1e-a276-f74b9c5559f4"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:35.084109 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a62b7f18-470a-4295-88ea-17b7b4dcfe36 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:35.091771 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a62b7f18-470a-4295-88ea-17b7b4dcfe36 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:35.092218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a62b7f18-470a-4295-88ea-17b7b4dcfe36 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:35.092981 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a62b7f18-470a-4295-88ea-17b7b4dcfe36 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:35.093412 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a62b7f18-470a-4295-88ea-17b7b4dcfe36 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:35.364390 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a62b7f18-470a-4295-88ea-17b7b4dcfe36 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285964 Jun 03 15:30:35.365493 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 267/522] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:30:35 2022] POST /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:30:35.499288 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1780729765", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68719859-5880-402e-b442-370597e1ce2f"}], "security_groups": [{"name": "tempest-securitygroup--372302846"}], "key_name": "tempest-keypair-83876481", "user_data": "}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:35.576154 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c8520e17-349a-4420-b703-6793339ec3fa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:35.577044 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c8520e17-349a-4420-b703-6793339ec3fa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:35.583982 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c8520e17-349a-4420-b703-6793339ec3fa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:35.584512 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c8520e17-349a-4420-b703-6793339ec3fa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:35.585378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c8520e17-349a-4420-b703-6793339ec3fa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:35.585871 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c8520e17-349a-4420-b703-6793339ec3fa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:35.605799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] validate_networks() for [('68719859-5880-402e-b442-370597e1ce2f', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:30:35.727377 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c8520e17-349a-4420-b703-6793339ec3fa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:35.736945 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c8520e17-349a-4420-b703-6793339ec3fa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1676 microversion: 2.1 time: 0.165370 Jun 03 15:30:35.737533 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 268/523] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:35 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:30:35.986084 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:30:35.986502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:30:35.986998 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:30:35.987406 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:30:35.987813 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:30:35.996622 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:35.997063 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:35.997847 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:35.998277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:36.015422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:30:36.020077 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for user 193a35a91a47410f8b12cb2e84b33e1f and project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:30:36.031295 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:30:36.033593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:30:36.081995 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8f46bea6-5a94-4caf-b24d-4dfaf2da84c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.587402 Jun 03 15:30:36.083305 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 256/524] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:30:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:30:36.092715 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6d627bd8-8db0-48ef-9e48-acc6b38a77cb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:36.097457 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6d627bd8-8db0-48ef-9e48-acc6b38a77cb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:36.155608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6d627bd8-8db0-48ef-9e48-acc6b38a77cb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:36.167316 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6d627bd8-8db0-48ef-9e48-acc6b38a77cb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1240 microversion: 2.1 time: 0.078219 Jun 03 15:30:36.173602 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 269/525] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:36 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:36.755365 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0ded1e17-eaa5-4072-9875-2ce8604303e5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:36.756095 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0ded1e17-eaa5-4072-9875-2ce8604303e5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:36.762793 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0ded1e17-eaa5-4072-9875-2ce8604303e5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:36.763246 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0ded1e17-eaa5-4072-9875-2ce8604303e5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:36.764012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0ded1e17-eaa5-4072-9875-2ce8604303e5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:36.764451 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0ded1e17-eaa5-4072-9875-2ce8604303e5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:36.901702 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0ded1e17-eaa5-4072-9875-2ce8604303e5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:36.909389 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0ded1e17-eaa5-4072-9875-2ce8604303e5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1676 microversion: 2.1 time: 0.158996 Jun 03 15:30:36.909960 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 257/526] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:36 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:37.184469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6a92d9b2-6889-491a-a8ba-27b264d24c40 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:37.185638 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6a92d9b2-6889-491a-a8ba-27b264d24c40 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:37.194700 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6a92d9b2-6889-491a-a8ba-27b264d24c40 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:37.195457 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6a92d9b2-6889-491a-a8ba-27b264d24c40 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:37.197025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6a92d9b2-6889-491a-a8ba-27b264d24c40 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:37.197659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6a92d9b2-6889-491a-a8ba-27b264d24c40 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:37.283443 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6a92d9b2-6889-491a-a8ba-27b264d24c40 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:37.291565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6a92d9b2-6889-491a-a8ba-27b264d24c40 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1310 microversion: 2.1 time: 0.110984 Jun 03 15:30:37.299721 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 270/527] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:37 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1310 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:37.926945 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3513dff1-06e8-4fb5-b28b-e642707e4c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:37.928553 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3513dff1-06e8-4fb5-b28b-e642707e4c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:37.935309 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3513dff1-06e8-4fb5-b28b-e642707e4c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:37.935854 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3513dff1-06e8-4fb5-b28b-e642707e4c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:37.936705 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3513dff1-06e8-4fb5-b28b-e642707e4c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:37.937209 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3513dff1-06e8-4fb5-b28b-e642707e4c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:38.205717 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3513dff1-06e8-4fb5-b28b-e642707e4c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:38.214134 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3513dff1-06e8-4fb5-b28b-e642707e4c33 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1676 microversion: 2.1 time: 0.290983 Jun 03 15:30:38.220921 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 258/528] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:37 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1676 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:38.309768 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5f015f36-1214-4a15-a70f-3305a0099044 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:38.310417 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5f015f36-1214-4a15-a70f-3305a0099044 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:38.317056 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5f015f36-1214-4a15-a70f-3305a0099044 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:38.317507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5f015f36-1214-4a15-a70f-3305a0099044 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:38.318277 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5f015f36-1214-4a15-a70f-3305a0099044 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:38.318750 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5f015f36-1214-4a15-a70f-3305a0099044 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:38.452800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5f015f36-1214-4a15-a70f-3305a0099044 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:38.460441 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5f015f36-1214-4a15-a70f-3305a0099044 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1365 microversion: 2.1 time: 0.154522 Jun 03 15:30:38.461187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 271/529] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:38 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:38.810467 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-e339ac4e-dd44-4076-a734-f9a8245b1602 req-875a9fdb-4f57-43ad-b1cb-78cfd084c2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49a8a8d-d24d-42e9-8a4d-775920a378aa", "tag": "d0141bfc-60f8-4d27-ac11-5366f93320f4"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:38.820695 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-e339ac4e-dd44-4076-a734-f9a8245b1602 req-875a9fdb-4f57-43ad-b1cb-78cfd084c2a4 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:38.821043 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-e339ac4e-dd44-4076-a734-f9a8245b1602 req-875a9fdb-4f57-43ad-b1cb-78cfd084c2a4 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:38.835416 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-e339ac4e-dd44-4076-a734-f9a8245b1602 req-875a9fdb-4f57-43ad-b1cb-78cfd084c2a4 service nova] Creating event network-changed:d0141bfc-60f8-4d27-ac11-5366f93320f4 for instance d49a8a8d-d24d-42e9-8a4d-775920a378aa on hv-cinder-83124 Jun 03 15:30:38.844002 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-e339ac4e-dd44-4076-a734-f9a8245b1602 req-875a9fdb-4f57-43ad-b1cb-78cfd084c2a4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038023 Jun 03 15:30:38.844613 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 259/530] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:30:39.231473 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2945eccd-4bd8-491d-b471-44fae17e763e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:39.232075 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2945eccd-4bd8-491d-b471-44fae17e763e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:39.239053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2945eccd-4bd8-491d-b471-44fae17e763e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:39.239498 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2945eccd-4bd8-491d-b471-44fae17e763e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:39.240265 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2945eccd-4bd8-491d-b471-44fae17e763e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:39.240696 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2945eccd-4bd8-491d-b471-44fae17e763e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:39.376909 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2945eccd-4bd8-491d-b471-44fae17e763e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:39.385175 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2945eccd-4bd8-491d-b471-44fae17e763e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1676 microversion: 2.1 time: 0.157491 Jun 03 15:30:39.385757 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 272/531] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:39 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:30:39.478644 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f02b6c95-605e-48a1-8569-45a4ec2db8a9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:39.479325 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f02b6c95-605e-48a1-8569-45a4ec2db8a9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:39.486246 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f02b6c95-605e-48a1-8569-45a4ec2db8a9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:39.486719 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f02b6c95-605e-48a1-8569-45a4ec2db8a9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:39.487491 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f02b6c95-605e-48a1-8569-45a4ec2db8a9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:39.487945 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f02b6c95-605e-48a1-8569-45a4ec2db8a9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:39.624280 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f02b6c95-605e-48a1-8569-45a4ec2db8a9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:39.632169 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f02b6c95-605e-48a1-8569-45a4ec2db8a9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1365 microversion: 2.1 time: 0.158161 Jun 03 15:30:39.632742 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 260/532] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:39 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:40.402759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8bdece65-d755-499d-aa0b-9e5d51456867 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:40.403367 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8bdece65-d755-499d-aa0b-9e5d51456867 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:40.410512 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8bdece65-d755-499d-aa0b-9e5d51456867 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:40.410989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8bdece65-d755-499d-aa0b-9e5d51456867 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:40.411758 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8bdece65-d755-499d-aa0b-9e5d51456867 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:40.412195 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8bdece65-d755-499d-aa0b-9e5d51456867 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:40.414971 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:40.571829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8bdece65-d755-499d-aa0b-9e5d51456867 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:40.581586 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8bdece65-d755-499d-aa0b-9e5d51456867 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1676 microversion: 2.1 time: 0.182644 Jun 03 15:30:40.583563 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 273/533] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:40 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:40.650169 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9f74b0f8-6e05-4314-acdb-e5b92b305475 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:40.651433 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9f74b0f8-6e05-4314-acdb-e5b92b305475 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:40.662161 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9f74b0f8-6e05-4314-acdb-e5b92b305475 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:40.665672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9f74b0f8-6e05-4314-acdb-e5b92b305475 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:40.666620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9f74b0f8-6e05-4314-acdb-e5b92b305475 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:40.667483 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9f74b0f8-6e05-4314-acdb-e5b92b305475 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:40.916100 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9f74b0f8-6e05-4314-acdb-e5b92b305475 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:40.925356 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9f74b0f8-6e05-4314-acdb-e5b92b305475 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1365 microversion: 2.1 time: 0.279476 Jun 03 15:30:40.926751 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 261/534] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:40 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:41.599145 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ef68cecb-7c11-4440-a979-087a7ecb30db tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:41.599752 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ef68cecb-7c11-4440-a979-087a7ecb30db tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:41.607420 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef68cecb-7c11-4440-a979-087a7ecb30db tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:41.607871 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef68cecb-7c11-4440-a979-087a7ecb30db tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:41.608890 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef68cecb-7c11-4440-a979-087a7ecb30db tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:41.611491 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef68cecb-7c11-4440-a979-087a7ecb30db tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:41.770236 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ef68cecb-7c11-4440-a979-087a7ecb30db tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:41.778406 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ef68cecb-7c11-4440-a979-087a7ecb30db tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1676 microversion: 2.1 time: 0.183010 Jun 03 15:30:41.779467 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 274/535] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:41 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:41.943723 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f2b52259-66b6-4a09-a0eb-9d03c836f27a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:41.944536 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f2b52259-66b6-4a09-a0eb-9d03c836f27a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:41.953745 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f2b52259-66b6-4a09-a0eb-9d03c836f27a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:41.954831 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f2b52259-66b6-4a09-a0eb-9d03c836f27a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:41.955801 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f2b52259-66b6-4a09-a0eb-9d03c836f27a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:41.956236 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f2b52259-66b6-4a09-a0eb-9d03c836f27a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:42.103699 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f2b52259-66b6-4a09-a0eb-9d03c836f27a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:42.116514 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f2b52259-66b6-4a09-a0eb-9d03c836f27a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1365 microversion: 2.1 time: 0.176764 Jun 03 15:30:42.118627 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 262/536] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:41 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:42.796480 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5c91c4ac-248d-46c5-98d3-5b9eca344f42 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:42.797156 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5c91c4ac-248d-46c5-98d3-5b9eca344f42 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:42.804144 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c91c4ac-248d-46c5-98d3-5b9eca344f42 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:42.804624 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c91c4ac-248d-46c5-98d3-5b9eca344f42 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:42.805390 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c91c4ac-248d-46c5-98d3-5b9eca344f42 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:42.805824 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c91c4ac-248d-46c5-98d3-5b9eca344f42 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:42.952343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5c91c4ac-248d-46c5-98d3-5b9eca344f42 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:42.963050 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5c91c4ac-248d-46c5-98d3-5b9eca344f42 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1653 microversion: 2.1 time: 0.170097 Jun 03 15:30:42.964321 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 275/537] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:42 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1653 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:42.972661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b227011c-7347-4cf2-813c-09f9aa036b5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:42.973613 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b227011c-7347-4cf2-813c-09f9aa036b5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:42.980617 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c646bd8a-210d-477d-a887-73ad31a22e15 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:42.980882 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b227011c-7347-4cf2-813c-09f9aa036b5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:42.981264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b227011c-7347-4cf2-813c-09f9aa036b5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:42.982168 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b227011c-7347-4cf2-813c-09f9aa036b5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:42.982692 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b227011c-7347-4cf2-813c-09f9aa036b5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:42.989094 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c646bd8a-210d-477d-a887-73ad31a22e15 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:42.989826 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c646bd8a-210d-477d-a887-73ad31a22e15 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:43.015703 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-b227011c-7347-4cf2-813c-09f9aa036b5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lazy-loading 'flavor' on Instance uuid 99322d93-058a-4216-a672-e7f482aab8d8 {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:30:43.017314 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c646bd8a-210d-477d-a887-73ad31a22e15 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Going to try to start instance {{(pid=117806) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 15:30:43.068129 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c646bd8a-210d-477d-a887-73ad31a22e15 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/action" status: 202 len: 0 microversion: 2.1 time: 0.091229 Jun 03 15:30:43.069660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 276/538] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:30:42 2022] POST /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 15:30:43.078271 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9089ee86-dd2e-40c9-a1b2-81782ba1fe89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:43.079033 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9089ee86-dd2e-40c9-a1b2-81782ba1fe89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:43.085881 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9089ee86-dd2e-40c9-a1b2-81782ba1fe89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:43.086342 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9089ee86-dd2e-40c9-a1b2-81782ba1fe89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:43.087184 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9089ee86-dd2e-40c9-a1b2-81782ba1fe89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:43.087621 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9089ee86-dd2e-40c9-a1b2-81782ba1fe89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:43.188513 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b227011c-7347-4cf2-813c-09f9aa036b5c tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/action" status: 200 len: 32 microversion: 2.1 time: 0.221800 Jun 03 15:30:43.191767 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 263/539] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:30:42 2022] POST /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 15:30:43.205245 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-09163ddd-ee2b-467e-9235-7f81d78fde73 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:43.207052 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-09163ddd-ee2b-467e-9235-7f81d78fde73 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:43.224901 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-09163ddd-ee2b-467e-9235-7f81d78fde73 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:43.225657 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-09163ddd-ee2b-467e-9235-7f81d78fde73 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:43.227152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-09163ddd-ee2b-467e-9235-7f81d78fde73 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:43.227695 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-09163ddd-ee2b-467e-9235-7f81d78fde73 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:43.318483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9089ee86-dd2e-40c9-a1b2-81782ba1fe89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:43.327227 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9089ee86-dd2e-40c9-a1b2-81782ba1fe89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1662 microversion: 2.1 time: 0.253122 Jun 03 15:30:43.332523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 277/540] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:43 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1662 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:30:43.339770 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5750ce11-f28f-4ca2-9b68-21297394e281 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:43.344004 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5750ce11-f28f-4ca2-9b68-21297394e281 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:43.353782 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5750ce11-f28f-4ca2-9b68-21297394e281 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:43.354472 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5750ce11-f28f-4ca2-9b68-21297394e281 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:43.364287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5750ce11-f28f-4ca2-9b68-21297394e281 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:43.365310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5750ce11-f28f-4ca2-9b68-21297394e281 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:43.488315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-09163ddd-ee2b-467e-9235-7f81d78fde73 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:43.500023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-09163ddd-ee2b-467e-9235-7f81d78fde73 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1365 microversion: 2.1 time: 0.306599 Jun 03 15:30:43.500607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 264/541] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:43 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:43.521153 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-5c22cdea-fa87-4920-baf6-8d02e157a91d req-fd02905e-b84f-4570-8a69-95ccf48017e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49a8a8d-d24d-42e9-8a4d-775920a378aa", "name": "network-vif-plugged", "status": "completed", "tag": "d0141bfc-60f8-4d27-ac11-5366f93320f4"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:43.549174 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-5c22cdea-fa87-4920-baf6-8d02e157a91d req-fd02905e-b84f-4570-8a69-95ccf48017e0 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:43.549628 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-5c22cdea-fa87-4920-baf6-8d02e157a91d req-fd02905e-b84f-4570-8a69-95ccf48017e0 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:43.574364 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-5c22cdea-fa87-4920-baf6-8d02e157a91d req-fd02905e-b84f-4570-8a69-95ccf48017e0 service nova] Creating event network-vif-plugged:d0141bfc-60f8-4d27-ac11-5366f93320f4 for instance d49a8a8d-d24d-42e9-8a4d-775920a378aa on hv-cinder-83124 Jun 03 15:30:43.588234 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-5c22cdea-fa87-4920-baf6-8d02e157a91d req-fd02905e-b84f-4570-8a69-95ccf48017e0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084893 Jun 03 15:30:43.589553 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 265/542] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:30:43.650090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5750ce11-f28f-4ca2-9b68-21297394e281 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:43.664678 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5750ce11-f28f-4ca2-9b68-21297394e281 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.330901 Jun 03 15:30:43.668594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 278/543] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:43 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:44.351130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ee133ddb-39c3-4d8a-bae4-cf21121fb81f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:44.351878 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ee133ddb-39c3-4d8a-bae4-cf21121fb81f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:44.359781 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ee133ddb-39c3-4d8a-bae4-cf21121fb81f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:44.360229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ee133ddb-39c3-4d8a-bae4-cf21121fb81f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:44.362741 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ee133ddb-39c3-4d8a-bae4-cf21121fb81f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:44.363214 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ee133ddb-39c3-4d8a-bae4-cf21121fb81f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:44.509694 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ee133ddb-39c3-4d8a-bae4-cf21121fb81f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:44.518252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c6c20c6f-452a-49bf-9281-6264d69904e8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:44.518991 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c6c20c6f-452a-49bf-9281-6264d69904e8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:44.519598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ee133ddb-39c3-4d8a-bae4-cf21121fb81f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1662 microversion: 2.1 time: 0.173836 Jun 03 15:30:44.520186 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 266/544] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:44 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1662 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:44.527654 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c6c20c6f-452a-49bf-9281-6264d69904e8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:44.528099 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c6c20c6f-452a-49bf-9281-6264d69904e8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:44.528915 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c6c20c6f-452a-49bf-9281-6264d69904e8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:44.529391 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c6c20c6f-452a-49bf-9281-6264d69904e8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:44.665283 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c6c20c6f-452a-49bf-9281-6264d69904e8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:44.673633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c6c20c6f-452a-49bf-9281-6264d69904e8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1365 microversion: 2.1 time: 0.159262 Jun 03 15:30:44.674242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 279/545] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:44 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:44.685171 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d60c7486-4bd6-4a5c-af70-89315b7fabc4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:44.685770 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d60c7486-4bd6-4a5c-af70-89315b7fabc4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:44.692803 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d60c7486-4bd6-4a5c-af70-89315b7fabc4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:44.693250 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d60c7486-4bd6-4a5c-af70-89315b7fabc4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:44.694342 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d60c7486-4bd6-4a5c-af70-89315b7fabc4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:44.694477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d60c7486-4bd6-4a5c-af70-89315b7fabc4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:44.837724 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d60c7486-4bd6-4a5c-af70-89315b7fabc4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:44.846149 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d60c7486-4bd6-4a5c-af70-89315b7fabc4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.164796 Jun 03 15:30:44.846974 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 267/546] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:44 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:45.537415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-852b796e-d313-41ee-811b-d3b023294931 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:45.538020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-852b796e-d313-41ee-811b-d3b023294931 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:45.544941 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-852b796e-d313-41ee-811b-d3b023294931 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:45.545388 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-852b796e-d313-41ee-811b-d3b023294931 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:45.546150 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-852b796e-d313-41ee-811b-d3b023294931 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:45.546605 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-852b796e-d313-41ee-811b-d3b023294931 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:45.690349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-852b796e-d313-41ee-811b-d3b023294931 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:45.691421 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a2cec677-a235-4fcc-825c-90057f92feeb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:45.692185 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a2cec677-a235-4fcc-825c-90057f92feeb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:45.699410 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-852b796e-d313-41ee-811b-d3b023294931 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1666 microversion: 2.1 time: 0.165909 Jun 03 15:30:45.701275 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2cec677-a235-4fcc-825c-90057f92feeb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:45.701415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 280/547] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:45 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:45.701514 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2cec677-a235-4fcc-825c-90057f92feeb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:45.701670 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2cec677-a235-4fcc-825c-90057f92feeb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:45.702115 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2cec677-a235-4fcc-825c-90057f92feeb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:45.845019 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a2cec677-a235-4fcc-825c-90057f92feeb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:45.847675 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:45.854415 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a2cec677-a235-4fcc-825c-90057f92feeb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1365 microversion: 2.1 time: 0.167475 Jun 03 15:30:45.855221 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 268/548] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:45 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:30:45.865740 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5b49737a-35c9-4aa5-937d-0e5c227d188a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:45.866339 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5b49737a-35c9-4aa5-937d-0e5c227d188a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:45.876822 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5b49737a-35c9-4aa5-937d-0e5c227d188a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:45.877286 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5b49737a-35c9-4aa5-937d-0e5c227d188a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:45.878074 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5b49737a-35c9-4aa5-937d-0e5c227d188a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:45.878513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5b49737a-35c9-4aa5-937d-0e5c227d188a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:46.041231 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5b49737a-35c9-4aa5-937d-0e5c227d188a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:46.049999 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5b49737a-35c9-4aa5-937d-0e5c227d188a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.187977 Jun 03 15:30:46.050795 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 281/549] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:45 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:46.872331 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0afd5bf2-9a40-494c-8d3c-f41ddb536241 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:46.872965 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0afd5bf2-9a40-494c-8d3c-f41ddb536241 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:46.875391 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:46.876031 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=6 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:46.884097 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0afd5bf2-9a40-494c-8d3c-f41ddb536241 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:46.884543 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0afd5bf2-9a40-494c-8d3c-f41ddb536241 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:46.885311 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0afd5bf2-9a40-494c-8d3c-f41ddb536241 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:46.885748 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0afd5bf2-9a40-494c-8d3c-f41ddb536241 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:47.024301 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0afd5bf2-9a40-494c-8d3c-f41ddb536241 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:47.032404 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0afd5bf2-9a40-494c-8d3c-f41ddb536241 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1556 microversion: 2.1 time: 0.163802 Jun 03 15:30:47.032982 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 269/550] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:46 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:47.059885 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-98e5e3ad-cab0-4a43-b285-4aeae3080e9d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:47.060471 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-98e5e3ad-cab0-4a43-b285-4aeae3080e9d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:47.062449 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=6 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:47.070059 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98e5e3ad-cab0-4a43-b285-4aeae3080e9d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:47.070284 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a3d7f50a-71bd-4090-9931-0199cc6b3fdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:47.070505 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98e5e3ad-cab0-4a43-b285-4aeae3080e9d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:47.070731 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a3d7f50a-71bd-4090-9931-0199cc6b3fdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:47.071339 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98e5e3ad-cab0-4a43-b285-4aeae3080e9d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:47.071777 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98e5e3ad-cab0-4a43-b285-4aeae3080e9d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:47.077797 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a3d7f50a-71bd-4090-9931-0199cc6b3fdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:47.078257 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a3d7f50a-71bd-4090-9931-0199cc6b3fdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:47.079080 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a3d7f50a-71bd-4090-9931-0199cc6b3fdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:47.079518 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a3d7f50a-71bd-4090-9931-0199cc6b3fdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:47.165018 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-98e5e3ad-cab0-4a43-b285-4aeae3080e9d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109106 Jun 03 15:30:47.165708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 282/551] 10.222.0.93 () {58 vars in 1274 bytes} [Fri Jun 3 15:30:47 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:30:47.234773 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a3d7f50a-71bd-4090-9931-0199cc6b3fdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:47.244934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a3d7f50a-71bd-4090-9931-0199cc6b3fdd tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.179302 Jun 03 15:30:47.245844 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 270/552] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:47 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:48.136966 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-891064c4-9a64-4e92-88b0-97bea19c566c req-96ffa945-dbf9-4883-a02e-565b366f3ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49a8a8d-d24d-42e9-8a4d-775920a378aa", "tag": "d0141bfc-60f8-4d27-ac11-5366f93320f4"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:30:48.147044 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-891064c4-9a64-4e92-88b0-97bea19c566c req-96ffa945-dbf9-4883-a02e-565b366f3ec0 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:48.147487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-891064c4-9a64-4e92-88b0-97bea19c566c req-96ffa945-dbf9-4883-a02e-565b366f3ec0 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:48.159568 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-891064c4-9a64-4e92-88b0-97bea19c566c req-96ffa945-dbf9-4883-a02e-565b366f3ec0 service nova] Creating event network-changed:d0141bfc-60f8-4d27-ac11-5366f93320f4 for instance d49a8a8d-d24d-42e9-8a4d-775920a378aa on hv-cinder-83124 Jun 03 15:30:48.163972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-891064c4-9a64-4e92-88b0-97bea19c566c req-96ffa945-dbf9-4883-a02e-565b366f3ec0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031151 Jun 03 15:30:48.164903 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 283/553] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:30:48.265878 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0f7491d5-386b-4b84-b31b-733c4b76f1ab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:48.268417 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0f7491d5-386b-4b84-b31b-733c4b76f1ab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:48.278650 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0f7491d5-386b-4b84-b31b-733c4b76f1ab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:48.279604 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0f7491d5-386b-4b84-b31b-733c4b76f1ab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:48.280853 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0f7491d5-386b-4b84-b31b-733c4b76f1ab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:48.281555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0f7491d5-386b-4b84-b31b-733c4b76f1ab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:48.451386 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0f7491d5-386b-4b84-b31b-733c4b76f1ab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:48.459782 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0f7491d5-386b-4b84-b31b-733c4b76f1ab tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.199424 Jun 03 15:30:48.460538 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 271/554] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:48 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:49.478477 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-50621151-9e2b-430c-997b-2051bb406739 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:49.479206 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-50621151-9e2b-430c-997b-2051bb406739 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:49.485443 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50621151-9e2b-430c-997b-2051bb406739 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:49.485864 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50621151-9e2b-430c-997b-2051bb406739 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:49.486823 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50621151-9e2b-430c-997b-2051bb406739 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:49.487261 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50621151-9e2b-430c-997b-2051bb406739 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:49.623001 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-50621151-9e2b-430c-997b-2051bb406739 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:49.631643 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-50621151-9e2b-430c-997b-2051bb406739 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.158125 Jun 03 15:30:49.632212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 284/555] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:49 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:50.648324 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cc17e888-fee4-4d40-bce4-1797fd6eb09f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:50.648934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-cc17e888-fee4-4d40-bce4-1797fd6eb09f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:50.655651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc17e888-fee4-4d40-bce4-1797fd6eb09f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:50.656091 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc17e888-fee4-4d40-bce4-1797fd6eb09f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:50.656852 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc17e888-fee4-4d40-bce4-1797fd6eb09f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:50.657282 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc17e888-fee4-4d40-bce4-1797fd6eb09f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:50.793783 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-cc17e888-fee4-4d40-bce4-1797fd6eb09f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:50.802562 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-cc17e888-fee4-4d40-bce4-1797fd6eb09f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.158048 Jun 03 15:30:50.803126 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 272/556] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:50 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:30:51.819487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-36c824bb-1b9e-4457-b5b2-628953ba2834 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:51.820028 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-36c824bb-1b9e-4457-b5b2-628953ba2834 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:51.822406 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:51.827779 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-36c824bb-1b9e-4457-b5b2-628953ba2834 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:51.828223 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-36c824bb-1b9e-4457-b5b2-628953ba2834 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:51.829076 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-36c824bb-1b9e-4457-b5b2-628953ba2834 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:51.829507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-36c824bb-1b9e-4457-b5b2-628953ba2834 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:51.964933 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-36c824bb-1b9e-4457-b5b2-628953ba2834 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:51.975148 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-36c824bb-1b9e-4457-b5b2-628953ba2834 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.159721 Jun 03 15:30:51.975733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 285/557] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:51 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:52.993661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-099214d5-3eab-4a69-9477-da22311754dc tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:52.994251 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-099214d5-3eab-4a69-9477-da22311754dc tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:52.996767 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:53.002374 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-099214d5-3eab-4a69-9477-da22311754dc tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:53.002952 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-099214d5-3eab-4a69-9477-da22311754dc tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:53.003724 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-099214d5-3eab-4a69-9477-da22311754dc tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:53.004379 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-099214d5-3eab-4a69-9477-da22311754dc tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:53.141608 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-099214d5-3eab-4a69-9477-da22311754dc tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:53.150611 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-099214d5-3eab-4a69-9477-da22311754dc tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.161181 Jun 03 15:30:53.151180 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 273/558] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:52 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:54.168320 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a8fcb058-6d73-4456-9cfb-317f458a1db4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:54.168938 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a8fcb058-6d73-4456-9cfb-317f458a1db4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:54.176249 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a8fcb058-6d73-4456-9cfb-317f458a1db4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:54.176689 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a8fcb058-6d73-4456-9cfb-317f458a1db4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:54.177450 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a8fcb058-6d73-4456-9cfb-317f458a1db4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:54.177886 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a8fcb058-6d73-4456-9cfb-317f458a1db4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:54.304868 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a8fcb058-6d73-4456-9cfb-317f458a1db4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:54.312902 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a8fcb058-6d73-4456-9cfb-317f458a1db4 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.148456 Jun 03 15:30:54.313612 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 286/559] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:54 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:55.329061 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b4f62729-0d90-441a-a04b-0dec7939d1db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:55.329681 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b4f62729-0d90-441a-a04b-0dec7939d1db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:55.339337 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b4f62729-0d90-441a-a04b-0dec7939d1db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:55.339730 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b4f62729-0d90-441a-a04b-0dec7939d1db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:55.340538 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b4f62729-0d90-441a-a04b-0dec7939d1db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:55.340974 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b4f62729-0d90-441a-a04b-0dec7939d1db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:55.474285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b4f62729-0d90-441a-a04b-0dec7939d1db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:55.482306 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b4f62729-0d90-441a-a04b-0dec7939d1db tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.157084 Jun 03 15:30:55.482898 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 274/560] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:55 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:56.498749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f10bee7f-bbf0-49d7-bf09-5a4abb2236cb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:56.499362 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f10bee7f-bbf0-49d7-bf09-5a4abb2236cb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:56.506390 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f10bee7f-bbf0-49d7-bf09-5a4abb2236cb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:56.506877 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f10bee7f-bbf0-49d7-bf09-5a4abb2236cb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:56.507735 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f10bee7f-bbf0-49d7-bf09-5a4abb2236cb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:56.508478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f10bee7f-bbf0-49d7-bf09-5a4abb2236cb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:56.643625 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f10bee7f-bbf0-49d7-bf09-5a4abb2236cb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:56.651612 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f10bee7f-bbf0-49d7-bf09-5a4abb2236cb tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.156733 Jun 03 15:30:56.652180 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 287/561] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:56 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:57.669780 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a65800a0-ac57-437e-839b-8fa4c7812f6a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:57.670348 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a65800a0-ac57-437e-839b-8fa4c7812f6a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:57.679708 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a65800a0-ac57-437e-839b-8fa4c7812f6a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:57.680164 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a65800a0-ac57-437e-839b-8fa4c7812f6a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:57.680940 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a65800a0-ac57-437e-839b-8fa4c7812f6a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:57.681380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a65800a0-ac57-437e-839b-8fa4c7812f6a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:57.823007 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a65800a0-ac57-437e-839b-8fa4c7812f6a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:57.832887 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a65800a0-ac57-437e-839b-8fa4c7812f6a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.167006 Jun 03 15:30:57.833461 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 275/562] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:57 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:58.850206 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-89ac85d3-4ad8-4908-846f-78c882edc418 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:58.850922 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-89ac85d3-4ad8-4908-846f-78c882edc418 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:58.857418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89ac85d3-4ad8-4908-846f-78c882edc418 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:58.857864 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89ac85d3-4ad8-4908-846f-78c882edc418 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:58.858702 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89ac85d3-4ad8-4908-846f-78c882edc418 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:58.859136 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-89ac85d3-4ad8-4908-846f-78c882edc418 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:58.988796 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-89ac85d3-4ad8-4908-846f-78c882edc418 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:30:58.996752 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-89ac85d3-4ad8-4908-846f-78c882edc418 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.150501 Jun 03 15:30:58.997310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 288/563] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:30:58 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:30:59.275415 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-22ddbb16-71d0-4e4d-b9dc-7bb1c4ff891f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:59.275971 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-22ddbb16-71d0-4e4d-b9dc-7bb1c4ff891f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:59.282634 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-22ddbb16-71d0-4e4d-b9dc-7bb1c4ff891f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:59.283088 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-22ddbb16-71d0-4e4d-b9dc-7bb1c4ff891f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:59.283855 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-22ddbb16-71d0-4e4d-b9dc-7bb1c4ff891f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:59.284290 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-22ddbb16-71d0-4e4d-b9dc-7bb1c4ff891f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:59.312422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-22ddbb16-71d0-4e4d-b9dc-7bb1c4ff891f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments/b3ba06d0-6f0d-4a83-8854-45bcc7c08c35" status: 200 len: 194 microversion: 2.20 time: 0.041128 Jun 03 15:30:59.313013 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 276/564] 10.222.0.93 () {60 vars in 1453 bytes} [Fri Jun 3 15:30:59 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments/b3ba06d0-6f0d-4a83-8854-45bcc7c08c35 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:30:59.380193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-80784f35-2ba8-4960-a12c-924eb4e4bf8a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:59.380683 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-80784f35-2ba8-4960-a12c-924eb4e4bf8a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:59.387067 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-80784f35-2ba8-4960-a12c-924eb4e4bf8a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:59.387512 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-80784f35-2ba8-4960-a12c-924eb4e4bf8a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:59.388278 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-80784f35-2ba8-4960-a12c-924eb4e4bf8a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:59.388703 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-80784f35-2ba8-4960-a12c-924eb4e4bf8a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:59.469577 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:30:59.476318 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-80784f35-2ba8-4960-a12c-924eb4e4bf8a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lazy-loading 'services' on Instance uuid e123dc0c-78c6-44ce-b847-927843a3751c {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:30:59.563467 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-80784f35-2ba8-4960-a12c-924eb4e4bf8a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments/b3ba06d0-6f0d-4a83-8854-45bcc7c08c35" status: 202 len: 0 microversion: 2.20 time: 0.188197 Jun 03 15:30:59.563892 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 289/565] 10.222.0.93 () {60 vars in 1456 bytes} [Fri Jun 3 15:30:59 2022] DELETE /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments/b3ba06d0-6f0d-4a83-8854-45bcc7c08c35 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:30:59.573180 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-eed85ecd-42f6-422b-bef1-546b71799299 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:30:59.574151 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-eed85ecd-42f6-422b-bef1-546b71799299 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:30:59.581876 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eed85ecd-42f6-422b-bef1-546b71799299 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:59.581876 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eed85ecd-42f6-422b-bef1-546b71799299 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:59.581876 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eed85ecd-42f6-422b-bef1-546b71799299 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:30:59.581876 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eed85ecd-42f6-422b-bef1-546b71799299 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:30:59.616089 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-eed85ecd-42f6-422b-bef1-546b71799299 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046868 Jun 03 15:30:59.616812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 277/566] 10.222.0.93 () {60 vars in 1342 bytes} [Fri Jun 3 15:30:59 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 15:31:00.016616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4db2a6ad-b3ab-496b-9c7e-167cde8302bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:00.017461 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4db2a6ad-b3ab-496b-9c7e-167cde8302bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:00.024850 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4db2a6ad-b3ab-496b-9c7e-167cde8302bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:00.025385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4db2a6ad-b3ab-496b-9c7e-167cde8302bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:00.026285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4db2a6ad-b3ab-496b-9c7e-167cde8302bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:00.026826 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4db2a6ad-b3ab-496b-9c7e-167cde8302bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:00.172748 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4db2a6ad-b3ab-496b-9c7e-167cde8302bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:00.183625 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4db2a6ad-b3ab-496b-9c7e-167cde8302bf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.172668 Jun 03 15:31:00.184218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 290/567] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:00 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:00.628567 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-790a2ac5-c820-468e-9b9a-87514890c9c9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:00.629491 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-790a2ac5-c820-468e-9b9a-87514890c9c9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:00.636096 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-790a2ac5-c820-468e-9b9a-87514890c9c9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:00.636543 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-790a2ac5-c820-468e-9b9a-87514890c9c9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:00.637296 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-790a2ac5-c820-468e-9b9a-87514890c9c9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:00.637727 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-790a2ac5-c820-468e-9b9a-87514890c9c9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:00.669051 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-790a2ac5-c820-468e-9b9a-87514890c9c9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044980 Jun 03 15:31:00.669600 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 278/568] 10.222.0.93 () {60 vars in 1342 bytes} [Fri Jun 3 15:31:00 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:31:01.200808 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f7853568-43e0-4d58-956d-16d80e7e46df tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:01.201444 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f7853568-43e0-4d58-956d-16d80e7e46df tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:01.208316 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f7853568-43e0-4d58-956d-16d80e7e46df tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:01.208767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f7853568-43e0-4d58-956d-16d80e7e46df tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:01.209532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f7853568-43e0-4d58-956d-16d80e7e46df tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:01.210097 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f7853568-43e0-4d58-956d-16d80e7e46df tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:01.341914 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f7853568-43e0-4d58-956d-16d80e7e46df tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:01.350391 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f7853568-43e0-4d58-956d-16d80e7e46df tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.153418 Jun 03 15:31:01.350993 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 291/569] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:01 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:01.681132 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c75c7adc-7abf-4876-b055-c5acb0473a64 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:01.682070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c75c7adc-7abf-4876-b055-c5acb0473a64 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:01.689042 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c75c7adc-7abf-4876-b055-c5acb0473a64 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:01.690044 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c75c7adc-7abf-4876-b055-c5acb0473a64 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:01.690899 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c75c7adc-7abf-4876-b055-c5acb0473a64 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:01.691540 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c75c7adc-7abf-4876-b055-c5acb0473a64 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:01.721735 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c75c7adc-7abf-4876-b055-c5acb0473a64 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045020 Jun 03 15:31:01.725930 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 279/570] 10.222.0.93 () {60 vars in 1342 bytes} [Fri Jun 3 15:31:01 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:31:02.366989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6ba64483-bb5d-411b-a7bb-e49fbf4a74f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:02.367588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6ba64483-bb5d-411b-a7bb-e49fbf4a74f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:02.374065 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6ba64483-bb5d-411b-a7bb-e49fbf4a74f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:02.374514 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6ba64483-bb5d-411b-a7bb-e49fbf4a74f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:02.375316 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6ba64483-bb5d-411b-a7bb-e49fbf4a74f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:02.375745 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6ba64483-bb5d-411b-a7bb-e49fbf4a74f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:02.502674 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6ba64483-bb5d-411b-a7bb-e49fbf4a74f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:02.510569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6ba64483-bb5d-411b-a7bb-e49fbf4a74f7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.147471 Jun 03 15:31:02.511127 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 292/571] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:02 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:02.733407 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-09fa3c5c-6ec8-43b9-a4b2-c2e2ce8c2c43 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:02.734475 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-09fa3c5c-6ec8-43b9-a4b2-c2e2ce8c2c43 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:02.740916 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-09fa3c5c-6ec8-43b9-a4b2-c2e2ce8c2c43 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:02.741362 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-09fa3c5c-6ec8-43b9-a4b2-c2e2ce8c2c43 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:02.742126 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-09fa3c5c-6ec8-43b9-a4b2-c2e2ce8c2c43 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:02.742579 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-09fa3c5c-6ec8-43b9-a4b2-c2e2ce8c2c43 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:02.772479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-09fa3c5c-6ec8-43b9-a4b2-c2e2ce8c2c43 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043016 Jun 03 15:31:02.773033 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 280/572] 10.222.0.93 () {60 vars in 1342 bytes} [Fri Jun 3 15:31:02 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:02.828559 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-02851b34-13a0-4c1f-a2ed-6dd842a08e26 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:02.829048 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-02851b34-13a0-4c1f-a2ed-6dd842a08e26 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:02.835638 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-02851b34-13a0-4c1f-a2ed-6dd842a08e26 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:02.836074 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-02851b34-13a0-4c1f-a2ed-6dd842a08e26 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:02.836823 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-02851b34-13a0-4c1f-a2ed-6dd842a08e26 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:02.837252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-02851b34-13a0-4c1f-a2ed-6dd842a08e26 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:02.862205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-02851b34-13a0-4c1f-a2ed-6dd842a08e26 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Going to try to terminate instance {{(pid=117806) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:31:02.937117 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-02851b34-13a0-4c1f-a2ed-6dd842a08e26 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 204 len: 0 microversion: 2.20 time: 0.112011 Jun 03 15:31:02.937893 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 293/573] 10.222.0.93 () {60 vars in 1279 bytes} [Fri Jun 3 15:31:02 2022] DELETE /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 15:31:02.948887 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-70dec4ac-150c-498a-8e13-15d543c17e75 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:02.949495 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-70dec4ac-150c-498a-8e13-15d543c17e75 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:02.956421 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-70dec4ac-150c-498a-8e13-15d543c17e75 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:02.957236 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-70dec4ac-150c-498a-8e13-15d543c17e75 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:02.958040 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-70dec4ac-150c-498a-8e13-15d543c17e75 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:02.958506 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-70dec4ac-150c-498a-8e13-15d543c17e75 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:03.102811 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-70dec4ac-150c-498a-8e13-15d543c17e75 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:03.111416 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-70dec4ac-150c-498a-8e13-15d543c17e75 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:03.113041 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-70dec4ac-150c-498a-8e13-15d543c17e75 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:03.114202 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-70dec4ac-150c-498a-8e13-15d543c17e75 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.169911 Jun 03 15:31:03.114859 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 281/574] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:02 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:03.529410 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f39d9e90-f48a-40ec-8bf2-7c8fa0bd2f63 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:03.530106 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f39d9e90-f48a-40ec-8bf2-7c8fa0bd2f63 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:03.537205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f39d9e90-f48a-40ec-8bf2-7c8fa0bd2f63 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:03.537657 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f39d9e90-f48a-40ec-8bf2-7c8fa0bd2f63 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:03.538419 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f39d9e90-f48a-40ec-8bf2-7c8fa0bd2f63 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:03.538895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f39d9e90-f48a-40ec-8bf2-7c8fa0bd2f63 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:03.669414 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f39d9e90-f48a-40ec-8bf2-7c8fa0bd2f63 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:03.678670 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f39d9e90-f48a-40ec-8bf2-7c8fa0bd2f63 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.153366 Jun 03 15:31:03.679242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 294/575] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:03 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:04.132721 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-54e7f4e3-dc45-4ed3-be88-8aaabe660215 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:04.133329 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-54e7f4e3-dc45-4ed3-be88-8aaabe660215 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:04.139970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-54e7f4e3-dc45-4ed3-be88-8aaabe660215 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:04.140420 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-54e7f4e3-dc45-4ed3-be88-8aaabe660215 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:04.141475 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-54e7f4e3-dc45-4ed3-be88-8aaabe660215 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:04.142491 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-54e7f4e3-dc45-4ed3-be88-8aaabe660215 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:04.273985 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-54e7f4e3-dc45-4ed3-be88-8aaabe660215 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:04.281994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-54e7f4e3-dc45-4ed3-be88-8aaabe660215 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:04.283510 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-54e7f4e3-dc45-4ed3-be88-8aaabe660215 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:04.284660 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-54e7f4e3-dc45-4ed3-be88-8aaabe660215 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.155991 Jun 03 15:31:04.285208 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 282/576] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:04 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:31:04.696212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-43100f51-c773-4aab-bf32-4cb1dac4c190 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:04.696827 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-43100f51-c773-4aab-bf32-4cb1dac4c190 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:04.703347 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-43100f51-c773-4aab-bf32-4cb1dac4c190 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:04.703801 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-43100f51-c773-4aab-bf32-4cb1dac4c190 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:04.704574 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-43100f51-c773-4aab-bf32-4cb1dac4c190 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:04.705010 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-43100f51-c773-4aab-bf32-4cb1dac4c190 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:04.838945 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-43100f51-c773-4aab-bf32-4cb1dac4c190 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:04.846897 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-43100f51-c773-4aab-bf32-4cb1dac4c190 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1736 microversion: 2.1 time: 0.154604 Jun 03 15:31:04.847582 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 295/577] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:04 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:31:05.303466 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5e30ca09-f14a-4475-bf50-84928ae4fd08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:05.304080 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5e30ca09-f14a-4475-bf50-84928ae4fd08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:05.310421 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5e30ca09-f14a-4475-bf50-84928ae4fd08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:05.310959 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5e30ca09-f14a-4475-bf50-84928ae4fd08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:05.311729 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5e30ca09-f14a-4475-bf50-84928ae4fd08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:05.312176 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5e30ca09-f14a-4475-bf50-84928ae4fd08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:05.419995 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-90114a4a-7a69-46db-88a9-e6f87a9e335e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1682147940"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:05.420656 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-90114a4a-7a69-46db-88a9-e6f87a9e335e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:05.427190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90114a4a-7a69-46db-88a9-e6f87a9e335e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:05.427642 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90114a4a-7a69-46db-88a9-e6f87a9e335e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:05.428390 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90114a4a-7a69-46db-88a9-e6f87a9e335e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:05.428819 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-90114a4a-7a69-46db-88a9-e6f87a9e335e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:05.449769 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5e30ca09-f14a-4475-bf50-84928ae4fd08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:05.457772 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5e30ca09-f14a-4475-bf50-84928ae4fd08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:05.459314 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5e30ca09-f14a-4475-bf50-84928ae4fd08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:05.460469 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5e30ca09-f14a-4475-bf50-84928ae4fd08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.160993 Jun 03 15:31:05.461033 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 283/578] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:05 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:31:05.586505 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.network.security_group_api [None req-90114a4a-7a69-46db-88a9-e6f87a9e335e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Removing security group a693cf21-50d5-4e38-8e93-263cac144c13 from port 3013216d-76f3-469e-9c86-a0bc71687991 Jun 03 15:31:05.864150 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-efb9a546-dc07-4947-b0f7-e5037f2dff89 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:05.864708 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-efb9a546-dc07-4947-b0f7-e5037f2dff89 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:05.870835 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-efb9a546-dc07-4947-b0f7-e5037f2dff89 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:05.871281 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-efb9a546-dc07-4947-b0f7-e5037f2dff89 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:05.872050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-efb9a546-dc07-4947-b0f7-e5037f2dff89 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:05.872484 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-efb9a546-dc07-4947-b0f7-e5037f2dff89 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:06.023740 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-efb9a546-dc07-4947-b0f7-e5037f2dff89 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:06.032660 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-efb9a546-dc07-4947-b0f7-e5037f2dff89 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1716 microversion: 2.1 time: 0.172263 Jun 03 15:31:06.033240 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 284/579] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:05 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1716 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:31:06.088287 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a2a12689-47ab-44da-87a8-08b20fbc3160 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:06.088811 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a2a12689-47ab-44da-87a8-08b20fbc3160 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:06.096144 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2a12689-47ab-44da-87a8-08b20fbc3160 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:06.096601 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2a12689-47ab-44da-87a8-08b20fbc3160 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:06.097389 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2a12689-47ab-44da-87a8-08b20fbc3160 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:06.097828 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a2a12689-47ab-44da-87a8-08b20fbc3160 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:06.115094 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=100 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:06.195440 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-a2a12689-47ab-44da-87a8-08b20fbc3160 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] HTTP exception thrown: Cannot 'detach_volume' instance 99322d93-058a-4216-a672-e7f482aab8d8 while it is in vm_state rescued Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a2a12689-47ab-44da-87a8-08b20fbc3160 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Request method failure captured: Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: DELETE /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments/211032b0-631a-4e1e-a276-f74b9c5559f4 HTTP/1.1 Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimihFnnSpT9vHcDE8w6rETruaBiPqie-4gBLlICtuPxNIrX0L7M8mdfgmZlPQf6rvIjW8Fnhg2auvD99GfAJ0MDd3ZgsJRSnPycIpx0d5syjzQnhKJUa-jr3zhJXj3ZKMz4Ll2eHi5iI_vUx_dL-hj77lNzuSckrOXnuBrt6wdhuCS6g Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: a402ec1153624838be07cda58279f2a4 Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:31:06.198479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a402ec1153624838be07cda58279f2a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a402ec1153624838be07cda58279f2a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a402ec1153624838be07cda58279f2a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a402ec1153624838be07cda58279f2a4"}]}] Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: a402ec1153624838be07cda58279f2a4 Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-ServerRescueNegativeTestJSON-2095995501-project Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 127a6938bc5c4416a9a502d9064344cd Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2095995501-project Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:31:06.199980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Cannot 'detach_volume' instance 99322d93-058a-4216-a672-e7f482aab8d8 while it is in vm_state rescued Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'server_id': '99322d93-058a-4216-a672-e7f482aab8d8', 'id': '211032b0-631a-4e1e-a276-f74b9c5559f4'} Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 99322d93-058a-4216-a672-e7f482aab8d8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:31:06.200638 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 99322d93-058a-4216-a672-e7f482aab8d8 while it is in vm_state rescued Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 99322d93-058a-4216-a672-e7f482aab8d8 while it is in vm_state rescued Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:06.202315 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a2a12689-47ab-44da-87a8-08b20fbc3160 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Returning 409 to user: Cannot 'detach_volume' instance 99322d93-058a-4216-a672-e7f482aab8d8 while it is in vm_state rescued {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:31:06.203533 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a2a12689-47ab-44da-87a8-08b20fbc3160 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "DELETE /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments/211032b0-631a-4e1e-a276-f74b9c5559f4" status: 409 len: 152 microversion: 2.1 time: 0.116586 Jun 03 15:31:06.203533 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 285/580] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:31:06 2022] DELETE /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments/211032b0-631a-4e1e-a276-f74b9c5559f4 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 03 15:31:06.215583 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-eb4f353f-c7d9-419e-b570-80b6f99a9a70 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:06.216120 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-eb4f353f-c7d9-419e-b570-80b6f99a9a70 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:06.224404 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb4f353f-c7d9-419e-b570-80b6f99a9a70 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:06.224914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb4f353f-c7d9-419e-b570-80b6f99a9a70 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:06.225769 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb4f353f-c7d9-419e-b570-80b6f99a9a70 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:06.226209 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb4f353f-c7d9-419e-b570-80b6f99a9a70 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:06.300574 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-eb4f353f-c7d9-419e-b570-80b6f99a9a70 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "POST /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/action" status: 202 len: 0 microversion: 2.1 time: 0.091540 Jun 03 15:31:06.301424 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 286/581] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:31:06 2022] POST /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:31:06.309751 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-34deb5fa-c489-481b-be4a-dc801448d675 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:06.310506 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-34deb5fa-c489-481b-be4a-dc801448d675 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:06.318238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-34deb5fa-c489-481b-be4a-dc801448d675 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:06.318848 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-34deb5fa-c489-481b-be4a-dc801448d675 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:06.319812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-34deb5fa-c489-481b-be4a-dc801448d675 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:06.320436 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-34deb5fa-c489-481b-be4a-dc801448d675 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:06.540895 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-34deb5fa-c489-481b-be4a-dc801448d675 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:06.552068 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-34deb5fa-c489-481b-be4a-dc801448d675 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1724 microversion: 2.1 time: 0.246166 Jun 03 15:31:06.562186 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 287/582] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:06 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:31:06.567728 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7abc6aad-621c-492d-a01e-4e2c0ba57f8d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:06.568331 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7abc6aad-621c-492d-a01e-4e2c0ba57f8d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:06.575335 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7abc6aad-621c-492d-a01e-4e2c0ba57f8d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:06.576200 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7abc6aad-621c-492d-a01e-4e2c0ba57f8d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:06.576554 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7abc6aad-621c-492d-a01e-4e2c0ba57f8d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:06.576988 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7abc6aad-621c-492d-a01e-4e2c0ba57f8d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:06.615621 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-90114a4a-7a69-46db-88a9-e6f87a9e335e tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "POST /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/action" status: 202 len: 0 microversion: 2.1 time: 1.198748 Jun 03 15:31:06.616357 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 296/583] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:31:05 2022] POST /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/action => generated 0 bytes in 1201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 15:31:06.629708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-8c625e32-32cd-4f1f-94ce-9b0c52833c29 req-033ee0d7-716c-4e61-9bdb-d4f0581d1648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f284eb-df90-4337-8bdf-511156b6a756", "tag": "3013216d-76f3-469e-9c86-a0bc71687991"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:06.641189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-8c625e32-32cd-4f1f-94ce-9b0c52833c29 req-033ee0d7-716c-4e61-9bdb-d4f0581d1648 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:06.641958 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-8c625e32-32cd-4f1f-94ce-9b0c52833c29 req-033ee0d7-716c-4e61-9bdb-d4f0581d1648 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:06.657150 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-8c625e32-32cd-4f1f-94ce-9b0c52833c29 req-033ee0d7-716c-4e61-9bdb-d4f0581d1648 service nova] Creating event network-changed:3013216d-76f3-469e-9c86-a0bc71687991 for instance 67f284eb-df90-4337-8bdf-511156b6a756 on hv-cinder-83124 Jun 03 15:31:06.665998 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-8c625e32-32cd-4f1f-94ce-9b0c52833c29 req-033ee0d7-716c-4e61-9bdb-d4f0581d1648 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042475 Jun 03 15:31:06.667636 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 297/584] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:31:07.215555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7abc6aad-621c-492d-a01e-4e2c0ba57f8d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:07.235629 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7abc6aad-621c-492d-a01e-4e2c0ba57f8d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:07.247421 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7abc6aad-621c-492d-a01e-4e2c0ba57f8d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:07.248831 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7abc6aad-621c-492d-a01e-4e2c0ba57f8d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 200 len: 1723 microversion: 2.20 time: 0.685110 Jun 03 15:31:07.251593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 288/585] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:06 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 1723 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:07.571820 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-475a3bb5-4fa4-4cd6-89d0-af202b2efba6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:07.573531 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-475a3bb5-4fa4-4cd6-89d0-af202b2efba6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:07.583686 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-475a3bb5-4fa4-4cd6-89d0-af202b2efba6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:07.584168 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-475a3bb5-4fa4-4cd6-89d0-af202b2efba6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:07.585164 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-475a3bb5-4fa4-4cd6-89d0-af202b2efba6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:07.585769 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-475a3bb5-4fa4-4cd6-89d0-af202b2efba6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:07.806869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-475a3bb5-4fa4-4cd6-89d0-af202b2efba6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:07.821095 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-475a3bb5-4fa4-4cd6-89d0-af202b2efba6 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1724 microversion: 2.1 time: 0.254822 Jun 03 15:31:07.832422 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 298/586] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:07 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:08.272729 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c097ceac-80ed-4b83-94c5-caab97784a86 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:08.273964 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c097ceac-80ed-4b83-94c5-caab97784a86 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:08.286513 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c097ceac-80ed-4b83-94c5-caab97784a86 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:08.288986 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c097ceac-80ed-4b83-94c5-caab97784a86 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:08.289796 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c097ceac-80ed-4b83-94c5-caab97784a86 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:08.290268 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c097ceac-80ed-4b83-94c5-caab97784a86 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:08.304172 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b3bf642f-2fe8-4be0-b677-ede7d00d7687 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:08.304908 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b3bf642f-2fe8-4be0-b677-ede7d00d7687 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:08.309275 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-c097ceac-80ed-4b83-94c5-caab97784a86 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] HTTP exception thrown: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c097ceac-80ed-4b83-94c5-caab97784a86 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Request method failure captured: Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c HTTP/1.1 Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimihI4URsvyYFvhDathagTTdPKdj6XVGiCBU9lcp_hT6pwVjQ1hJutaB1k-rB_p8nu-EG4gcrwbZ_UuuwSFQWm7rcD1ClXa0WxMSG73DDJD0zz0FSWh2yKgqcE3vbCNh3Zxxj1ujVuAr2KwUNJ49O1bACUs1o66yZXNhbOXTWQJSKyMY Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:31:08.311173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1b930cadb2dc4e49947db0514528617d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1b930cadb2dc4e49947db0514528617d"}]}] Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 47d7587d10b3487688ed251a85b83c97 Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:31:08.312910 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': 'e123dc0c-78c6-44ce-b847-927843a3751c'} Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:31:08.314021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:31:08.315633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:08.317051 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c097ceac-80ed-4b83-94c5-caab97784a86 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Returning 404 to user: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:31:08.317051 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c097ceac-80ed-4b83-94c5-caab97784a86 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 404 len: 111 microversion: 2.20 time: 0.047697 Jun 03 15:31:08.317051 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 289/587] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:08 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:31:08.318498 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b3bf642f-2fe8-4be0-b677-ede7d00d7687 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:08.319094 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b3bf642f-2fe8-4be0-b677-ede7d00d7687 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:08.319972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b3bf642f-2fe8-4be0-b677-ede7d00d7687 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:08.320508 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b3bf642f-2fe8-4be0-b677-ede7d00d7687 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:08.321720 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cb8fdda2-03d5-42cd-9a7f-53044d58a91d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '.version_select at 0x7f92f0cf9700>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:08.341812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-cb8fdda2-03d5-42cd-9a7f-53044d58a91d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-317052014" status: 204 len: 0 microversion: 2.20 time: 0.023690 Jun 03 15:31:08.346865 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 290/588] 10.222.0.93 () {60 vars in 1258 bytes} [Fri Jun 3 15:31:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-317052014 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 15:31:08.440760 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-b3bf642f-2fe8-4be0-b677-ede7d00d7687 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lazy-loading 'services' on Instance uuid 67f284eb-df90-4337-8bdf-511156b6a756 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:31:08.526487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b3bf642f-2fe8-4be0-b677-ede7d00d7687 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "DELETE /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments/966626ff-cc10-42b5-ac79-06fffa57d175" status: 202 len: 0 microversion: 2.1 time: 0.225965 Jun 03 15:31:08.527242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 299/589] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:31:08 2022] DELETE /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments/966626ff-cc10-42b5-ac79-06fffa57d175 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:31:08.535887 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-32bbbdfb-1d32-4f78-9136-a44aee15c074 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:08.537092 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-32bbbdfb-1d32-4f78-9136-a44aee15c074 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:08.543528 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32bbbdfb-1d32-4f78-9136-a44aee15c074 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:08.543974 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32bbbdfb-1d32-4f78-9136-a44aee15c074 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:08.544743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32bbbdfb-1d32-4f78-9136-a44aee15c074 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:08.545174 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32bbbdfb-1d32-4f78-9136-a44aee15c074 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:08.578022 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-32bbbdfb-1d32-4f78-9136-a44aee15c074 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045995 Jun 03 15:31:08.579719 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 291/590] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:08 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:08.701292 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-7cd63cdc-a817-4106-aeba-ae7feabdab7b req-d85f656a-c3b3-4b72-b88a-b7448d91484a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123dc0c-78c6-44ce-b847-927843a3751c", "name": "network-vif-deleted", "tag": "d065a51d-4c7e-482f-87f7-74c4d679a6c1"}, {"name": "network-changed", "server_uuid": "67f284eb-df90-4337-8bdf-511156b6a756", "tag": "3013216d-76f3-469e-9c86-a0bc71687991"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:08.712200 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-7cd63cdc-a817-4106-aeba-ae7feabdab7b req-d85f656a-c3b3-4b72-b88a-b7448d91484a service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:08.712645 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-7cd63cdc-a817-4106-aeba-ae7feabdab7b req-d85f656a-c3b3-4b72-b88a-b7448d91484a service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:08.725867 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-7cd63cdc-a817-4106-aeba-ae7feabdab7b req-d85f656a-c3b3-4b72-b88a-b7448d91484a service nova] Creating event network-vif-deleted:d065a51d-4c7e-482f-87f7-74c4d679a6c1 for instance e123dc0c-78c6-44ce-b847-927843a3751c on hv-cinder-83124 Jun 03 15:31:08.726368 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-7cd63cdc-a817-4106-aeba-ae7feabdab7b req-d85f656a-c3b3-4b72-b88a-b7448d91484a service nova] Creating event network-changed:3013216d-76f3-469e-9c86-a0bc71687991 for instance 67f284eb-df90-4337-8bdf-511156b6a756 on hv-cinder-83124 Jun 03 15:31:08.733368 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-7cd63cdc-a817-4106-aeba-ae7feabdab7b req-d85f656a-c3b3-4b72-b88a-b7448d91484a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036867 Jun 03 15:31:08.735028 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 300/591] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:08.845219 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-eb6df6f1-3276-4308-8cd4-030ca8486f01 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:08.845842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-eb6df6f1-3276-4308-8cd4-030ca8486f01 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:08.852209 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb6df6f1-3276-4308-8cd4-030ca8486f01 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:08.852666 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb6df6f1-3276-4308-8cd4-030ca8486f01 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:08.853446 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb6df6f1-3276-4308-8cd4-030ca8486f01 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:08.853885 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb6df6f1-3276-4308-8cd4-030ca8486f01 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:09.038496 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-eb6df6f1-3276-4308-8cd4-030ca8486f01 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:09.057975 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-eb6df6f1-3276-4308-8cd4-030ca8486f01 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1724 microversion: 2.1 time: 0.216947 Jun 03 15:31:09.058838 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 292/592] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:08 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:09.084989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3abd9254-5445-4af1-88f0-e7d715a06105 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Action: 'create', calling method: .version_select at 0x7f92f0aeff70>, body: {"keypair": {"name": "tempest-keypair-955430949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtej9Cotft+6K9zMY4lqvJ80aXDNCxrtP2Z/NcVl3zoCDdywqm+l1R+LvMt1KMqJ8HL+QI+eyn3wRkf3D/Byo5LOyEdX3n5nL4zjHZpfnVOB4dMOwUlR2qqHx/ZQU9Azg=="}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:09.110376 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-3abd9254-5445-4af1-88f0-e7d715a06105 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Getting quotas for project 1b930cadb2dc4e49947db0514528617d. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:31:09.116723 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-3abd9254-5445-4af1-88f0-e7d715a06105 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Getting quotas for user 47d7587d10b3487688ed251a85b83c97 and project 1b930cadb2dc4e49947db0514528617d. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:31:09.151642 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3abd9254-5445-4af1-88f0-e7d715a06105 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.074931 Jun 03 15:31:09.152762 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 301/593] 10.222.0.93 () {62 vars in 1199 bytes} [Fri Jun 3 15:31:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 15:31:09.589957 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-94b9a405-0aca-4db7-bfab-3aba7c59047b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:09.591062 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-94b9a405-0aca-4db7-bfab-3aba7c59047b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:09.601405 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-94b9a405-0aca-4db7-bfab-3aba7c59047b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:09.601866 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-94b9a405-0aca-4db7-bfab-3aba7c59047b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:09.603121 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-94b9a405-0aca-4db7-bfab-3aba7c59047b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:09.603599 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-94b9a405-0aca-4db7-bfab-3aba7c59047b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:09.635516 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-94b9a405-0aca-4db7-bfab-3aba7c59047b tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049876 Jun 03 15:31:09.636013 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 293/594] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:09 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:10.077672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e46e6a58-69eb-46cd-ae3c-564c84ff7f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:10.078956 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e46e6a58-69eb-46cd-ae3c-564c84ff7f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:10.087437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e46e6a58-69eb-46cd-ae3c-564c84ff7f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:10.088119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e46e6a58-69eb-46cd-ae3c-564c84ff7f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:10.088724 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e46e6a58-69eb-46cd-ae3c-564c84ff7f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:10.089156 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e46e6a58-69eb-46cd-ae3c-564c84ff7f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:10.239900 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e46e6a58-69eb-46cd-ae3c-564c84ff7f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:10.249919 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e46e6a58-69eb-46cd-ae3c-564c84ff7f78 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1724 microversion: 2.1 time: 0.176179 Jun 03 15:31:10.250916 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 302/595] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:10 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:10.647977 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3adaecb4-c32b-41b8-b68f-9d5b359a4202 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:10.648935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3adaecb4-c32b-41b8-b68f-9d5b359a4202 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:10.656690 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3adaecb4-c32b-41b8-b68f-9d5b359a4202 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:10.657995 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3adaecb4-c32b-41b8-b68f-9d5b359a4202 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:10.659120 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3adaecb4-c32b-41b8-b68f-9d5b359a4202 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:10.659986 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3adaecb4-c32b-41b8-b68f-9d5b359a4202 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:10.682197 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-719037041", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6297c62b-cf60-4797-8fdd-d236a362ff82"}], "security_groups": [{"name": "tempest-securitygroup--907679956"}], "key_name": "tempest-keypair-955430949", "user_data": "}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:10.695705 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3adaecb4-c32b-41b8-b68f-9d5b359a4202 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052413 Jun 03 15:31:10.696384 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 294/596] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:10 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:10.855718 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.network.neutron [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] validate_networks() for [('6297c62b-cf60-4797-8fdd-d236a362ff82', None, None, None, None, None)] {{(pid=117806) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:31:11.273183 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-802297ad-c4eb-4a72-9886-1384659d2e03 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:11.273812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-802297ad-c4eb-4a72-9886-1384659d2e03 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:11.285125 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-802297ad-c4eb-4a72-9886-1384659d2e03 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:11.285807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-802297ad-c4eb-4a72-9886-1384659d2e03 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:11.286776 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-802297ad-c4eb-4a72-9886-1384659d2e03 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:11.287365 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-802297ad-c4eb-4a72-9886-1384659d2e03 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:11.293250 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Flavor limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:31:11.293734 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Image limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:31:11.294177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Flavor pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:31:11.294620 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Image pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:31:11.295036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:31:11.311914 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:11.312391 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:11.313177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:11.313647 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:11.339356 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Getting quotas for project 1b930cadb2dc4e49947db0514528617d. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:31:11.344046 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Getting quotas for user 47d7587d10b3487688ed251a85b83c97 and project 1b930cadb2dc4e49947db0514528617d. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:31:11.356745 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Going to run 1 instances... {{(pid=117806) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:31:11.359137 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:31:11.405722 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d9d53ec7-e91e-4114-b3c9-0c75c2bc681c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.727867 Jun 03 15:31:11.406751 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 303/597] 10.222.0.93 () {62 vars in 1187 bytes} [Fri Jun 3 15:31:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 03 15:31:11.418177 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5aa9c633-f64f-4654-85b7-e524aad709ae tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:11.418838 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5aa9c633-f64f-4654-85b7-e524aad709ae tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:11.491001 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5aa9c633-f64f-4654-85b7-e524aad709ae tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:11.499828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5aa9c633-f64f-4654-85b7-e524aad709ae tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:11.502416 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5aa9c633-f64f-4654-85b7-e524aad709ae tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:11.504129 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5aa9c633-f64f-4654-85b7-e524aad709ae tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1280 microversion: 2.20 time: 0.090409 Jun 03 15:31:11.515814 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 304/598] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:11 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:31:11.552797 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-802297ad-c4eb-4a72-9886-1384659d2e03 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:11.561166 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-802297ad-c4eb-4a72-9886-1384659d2e03 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1730 microversion: 2.1 time: 0.296674 Jun 03 15:31:11.573589 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 295/599] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:11 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1730 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:31:11.578710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b3e4858d-a6e2-4466-b586-b6c9d686eebf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:11.579340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b3e4858d-a6e2-4466-b586-b6c9d686eebf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:11.586739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b3e4858d-a6e2-4466-b586-b6c9d686eebf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:11.587329 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b3e4858d-a6e2-4466-b586-b6c9d686eebf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:11.588201 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b3e4858d-a6e2-4466-b586-b6c9d686eebf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:11.588752 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b3e4858d-a6e2-4466-b586-b6c9d686eebf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:11.675597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b3e4858d-a6e2-4466-b586-b6c9d686eebf tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101038 Jun 03 15:31:11.676510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 305/600] 10.222.0.93 () {58 vars in 1274 bytes} [Fri Jun 3 15:31:11 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:11.711200 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5cd3e4dd-38be-4ebf-a263-8f4c1703c148 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:11.712368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5cd3e4dd-38be-4ebf-a263-8f4c1703c148 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:11.720138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5cd3e4dd-38be-4ebf-a263-8f4c1703c148 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:11.720658 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5cd3e4dd-38be-4ebf-a263-8f4c1703c148 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:11.721445 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5cd3e4dd-38be-4ebf-a263-8f4c1703c148 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:11.722044 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5cd3e4dd-38be-4ebf-a263-8f4c1703c148 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:11.752630 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5cd3e4dd-38be-4ebf-a263-8f4c1703c148 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046169 Jun 03 15:31:11.753065 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 296/601] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:11 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 15:31:11.763454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c4b4887e-bc6e-4dc9-87c3-0fdaecf2aea0 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:11.763709 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c4b4887e-bc6e-4dc9-87c3-0fdaecf2aea0 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:11.770655 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c4b4887e-bc6e-4dc9-87c3-0fdaecf2aea0 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:11.771165 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c4b4887e-bc6e-4dc9-87c3-0fdaecf2aea0 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:11.772179 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c4b4887e-bc6e-4dc9-87c3-0fdaecf2aea0 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:11.772618 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c4b4887e-bc6e-4dc9-87c3-0fdaecf2aea0 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:11.860182 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-c4b4887e-bc6e-4dc9-87c3-0fdaecf2aea0 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] HTTP exception thrown: Instance 67f284eb-df90-4337-8bdf-511156b6a756 is not attached to volume 966626ff-cc10-42b5-ac79-06fffa57d175 Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c4b4887e-bc6e-4dc9-87c3-0fdaecf2aea0 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Request method failure captured: Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: DELETE /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments/966626ff-cc10-42b5-ac79-06fffa57d175 HTTP/1.1 Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimihnw6pUHNgqPxgdy9D5ND4Yd0hpS68DbJJvzfHyb1aIv33pR9eqQ0-XB79Zb_NF37KAT9kbV-HT8F18omzrZ8wkGwrqW9GV_Kr7r3npBSuhrh5PZSKRbXvg3uHGFZKFjFv-HIAHlQLkwqLjc3sFZl6vdnD2AzhHzM-NxCre2iqCsT8 Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 00d2022cc4be4779af1edf1520c439ae Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-TestMinimumBasicScenario-1235430946 Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:31:11.870869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00d2022cc4be4779af1edf1520c439ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00d2022cc4be4779af1edf1520c439ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00d2022cc4be4779af1edf1520c439ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00d2022cc4be4779af1edf1520c439ae"}]}] Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-TestMinimumBasicScenario-1235430946 Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 00d2022cc4be4779af1edf1520c439ae Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1235430946 Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-TestMinimumBasicScenario-1235430946-project Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: dac7f01263374a2cbdd892a2513f5ecd Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-TestMinimumBasicScenario-1235430946-project Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:31:11.872187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 67f284eb-df90-4337-8bdf-511156b6a756 is not attached to volume 966626ff-cc10-42b5-ac79-06fffa57d175 Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'server_id': '67f284eb-df90-4337-8bdf-511156b6a756', 'id': '966626ff-cc10-42b5-ac79-06fffa57d175'} Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 966626ff-cc10-42b5-ac79-06fffa57d175. Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:31:11.872904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f284eb-df90-4337-8bdf-511156b6a756 is not attached to volume 966626ff-cc10-42b5-ac79-06fffa57d175 Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f284eb-df90-4337-8bdf-511156b6a756 is not attached to volume 966626ff-cc10-42b5-ac79-06fffa57d175 Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:11.874000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c4b4887e-bc6e-4dc9-87c3-0fdaecf2aea0 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Returning 404 to user: Instance 67f284eb-df90-4337-8bdf-511156b6a756 is not attached to volume 966626ff-cc10-42b5-ac79-06fffa57d175 {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:31:11.874928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c4b4887e-bc6e-4dc9-87c3-0fdaecf2aea0 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "DELETE /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments/966626ff-cc10-42b5-ac79-06fffa57d175" status: 404 len: 154 microversion: 2.1 time: 0.113765 Jun 03 15:31:11.874928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 306/602] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:31:11 2022] DELETE /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756/os-volume_attachments/966626ff-cc10-42b5-ac79-06fffa57d175 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:31:12.525372 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6c53958a-436f-4e39-8e39-fb1c8e6106cd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:12.526258 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6c53958a-436f-4e39-8e39-fb1c8e6106cd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:12.535537 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6c53958a-436f-4e39-8e39-fb1c8e6106cd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:12.538426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6c53958a-436f-4e39-8e39-fb1c8e6106cd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:12.539719 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6c53958a-436f-4e39-8e39-fb1c8e6106cd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:12.540361 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6c53958a-436f-4e39-8e39-fb1c8e6106cd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:12.629446 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6c53958a-436f-4e39-8e39-fb1c8e6106cd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:12.641491 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6c53958a-436f-4e39-8e39-fb1c8e6106cd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:12.643552 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6c53958a-436f-4e39-8e39-fb1c8e6106cd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:12.644738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6c53958a-436f-4e39-8e39-fb1c8e6106cd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1350 microversion: 2.20 time: 0.123340 Jun 03 15:31:12.645700 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 297/603] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:12 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:12.845926 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-d124ce38-281d-4c46-8da5-9f596629dadc req-c5f727cb-a1a8-4176-b8ef-58ee3a5b98da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99322d93-058a-4216-a672-e7f482aab8d8", "tag": "3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:12.855383 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-d124ce38-281d-4c46-8da5-9f596629dadc req-c5f727cb-a1a8-4176-b8ef-58ee3a5b98da service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:12.856166 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-d124ce38-281d-4c46-8da5-9f596629dadc req-c5f727cb-a1a8-4176-b8ef-58ee3a5b98da service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:12.868311 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-d124ce38-281d-4c46-8da5-9f596629dadc req-c5f727cb-a1a8-4176-b8ef-58ee3a5b98da service nova] Creating event network-changed:3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee for instance 99322d93-058a-4216-a672-e7f482aab8d8 on hv-cinder-83124 Jun 03 15:31:12.873634 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-d124ce38-281d-4c46-8da5-9f596629dadc req-c5f727cb-a1a8-4176-b8ef-58ee3a5b98da service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032186 Jun 03 15:31:12.874560 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 307/604] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:13.023370 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b703e2d4-76b3-4960-a81c-86458fae8bd9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:13.023896 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b703e2d4-76b3-4960-a81c-86458fae8bd9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:13.030486 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b703e2d4-76b3-4960-a81c-86458fae8bd9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:13.031065 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b703e2d4-76b3-4960-a81c-86458fae8bd9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:13.032726 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b703e2d4-76b3-4960-a81c-86458fae8bd9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:13.033440 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b703e2d4-76b3-4960-a81c-86458fae8bd9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:13.058364 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b703e2d4-76b3-4960-a81c-86458fae8bd9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:31:13.144563 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b703e2d4-76b3-4960-a81c-86458fae8bd9 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "DELETE /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 204 len: 0 microversion: 2.1 time: 0.124830 Jun 03 15:31:13.146655 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 298/605] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:31:13 2022] DELETE /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:31:13.156781 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-cea82aa9-9439-4999-9707-b6b5198a5ecb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:13.158408 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-cea82aa9-9439-4999-9707-b6b5198a5ecb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:13.165771 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cea82aa9-9439-4999-9707-b6b5198a5ecb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:13.166507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cea82aa9-9439-4999-9707-b6b5198a5ecb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:13.167535 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cea82aa9-9439-4999-9707-b6b5198a5ecb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:13.168255 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cea82aa9-9439-4999-9707-b6b5198a5ecb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:13.316672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-cea82aa9-9439-4999-9707-b6b5198a5ecb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:13.319131 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:13.327111 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-cea82aa9-9439-4999-9707-b6b5198a5ecb tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1552 microversion: 2.1 time: 0.175557 Jun 03 15:31:13.328162 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 308/606] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:13 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:13.664031 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-431ef4db-ab41-4066-af79-9e51d0cb9280 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:13.664878 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-431ef4db-ab41-4066-af79-9e51d0cb9280 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:13.671193 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-431ef4db-ab41-4066-af79-9e51d0cb9280 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:13.671738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-431ef4db-ab41-4066-af79-9e51d0cb9280 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:13.673232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-431ef4db-ab41-4066-af79-9e51d0cb9280 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:13.673830 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-431ef4db-ab41-4066-af79-9e51d0cb9280 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:13.846176 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-431ef4db-ab41-4066-af79-9e51d0cb9280 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:13.854216 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-431ef4db-ab41-4066-af79-9e51d0cb9280 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:13.855746 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-431ef4db-ab41-4066-af79-9e51d0cb9280 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:13.856840 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-431ef4db-ab41-4066-af79-9e51d0cb9280 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1405 microversion: 2.20 time: 0.197220 Jun 03 15:31:13.857387 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 299/607] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:13 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:14.346945 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0c77bb27-7831-492f-9c5d-113d500db34f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:14.347557 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0c77bb27-7831-492f-9c5d-113d500db34f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:14.354950 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0c77bb27-7831-492f-9c5d-113d500db34f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:14.355394 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0c77bb27-7831-492f-9c5d-113d500db34f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:14.356160 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0c77bb27-7831-492f-9c5d-113d500db34f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:14.356595 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0c77bb27-7831-492f-9c5d-113d500db34f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:14.500753 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0c77bb27-7831-492f-9c5d-113d500db34f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:14.508392 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0c77bb27-7831-492f-9c5d-113d500db34f tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1552 microversion: 2.1 time: 0.166161 Jun 03 15:31:14.508995 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 309/608] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:14 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:14.876904 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c2edb071-0be0-4705-81dc-fb48c3293348 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:14.877524 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c2edb071-0be0-4705-81dc-fb48c3293348 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:14.884160 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2edb071-0be0-4705-81dc-fb48c3293348 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:14.884609 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2edb071-0be0-4705-81dc-fb48c3293348 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:14.885377 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2edb071-0be0-4705-81dc-fb48c3293348 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:14.885812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c2edb071-0be0-4705-81dc-fb48c3293348 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:14.888769 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-0b33d0a4-65df-4353-9f15-eac2a3b8e2b9 req-477a9bfb-ff28-409c-96ba-d23da3804b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99322d93-058a-4216-a672-e7f482aab8d8", "tag": "3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:14.897765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-0b33d0a4-65df-4353-9f15-eac2a3b8e2b9 req-477a9bfb-ff28-409c-96ba-d23da3804b1b service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:14.898203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-0b33d0a4-65df-4353-9f15-eac2a3b8e2b9 req-477a9bfb-ff28-409c-96ba-d23da3804b1b service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:14.909087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-0b33d0a4-65df-4353-9f15-eac2a3b8e2b9 req-477a9bfb-ff28-409c-96ba-d23da3804b1b service nova] Creating event network-changed:3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee for instance 99322d93-058a-4216-a672-e7f482aab8d8 on hv-cinder-83124 Jun 03 15:31:14.913860 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-0b33d0a4-65df-4353-9f15-eac2a3b8e2b9 req-477a9bfb-ff28-409c-96ba-d23da3804b1b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028718 Jun 03 15:31:14.914436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 310/609] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:31:15.018035 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c2edb071-0be0-4705-81dc-fb48c3293348 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:15.025995 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c2edb071-0be0-4705-81dc-fb48c3293348 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:15.027585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c2edb071-0be0-4705-81dc-fb48c3293348 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:15.028696 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c2edb071-0be0-4705-81dc-fb48c3293348 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1405 microversion: 2.20 time: 0.157282 Jun 03 15:31:15.029263 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 300/610] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:14 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:15.528012 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c86736ef-a915-430d-97fc-4992044f0f85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:15.528850 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c86736ef-a915-430d-97fc-4992044f0f85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:15.536132 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c86736ef-a915-430d-97fc-4992044f0f85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:15.536682 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c86736ef-a915-430d-97fc-4992044f0f85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:15.537670 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c86736ef-a915-430d-97fc-4992044f0f85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:15.538176 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c86736ef-a915-430d-97fc-4992044f0f85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:15.768800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c86736ef-a915-430d-97fc-4992044f0f85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac7f01263374a2cbdd892a2513f5ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d2022cc4be4779af1edf1520c439ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:15.778220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c86736ef-a915-430d-97fc-4992044f0f85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 200 len: 1552 microversion: 2.1 time: 0.255066 Jun 03 15:31:15.778827 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 311/611] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:15 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 1552 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:16.048836 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c4bd6761-c73e-496b-a760-b67e6754f110 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:16.050274 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c4bd6761-c73e-496b-a760-b67e6754f110 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:16.057390 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c4bd6761-c73e-496b-a760-b67e6754f110 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:16.058149 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c4bd6761-c73e-496b-a760-b67e6754f110 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:16.059326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c4bd6761-c73e-496b-a760-b67e6754f110 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:16.060175 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c4bd6761-c73e-496b-a760-b67e6754f110 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:16.080303 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:16.312232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c4bd6761-c73e-496b-a760-b67e6754f110 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:16.321840 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c4bd6761-c73e-496b-a760-b67e6754f110 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:16.323450 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c4bd6761-c73e-496b-a760-b67e6754f110 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:16.325119 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c4bd6761-c73e-496b-a760-b67e6754f110 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1405 microversion: 2.20 time: 0.282149 Jun 03 15:31:16.335380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 301/612] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:16 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1405 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:16.446063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-e0395fdc-15aa-4b52-85a8-c27410c64231 req-57c15225-0d82-4d9a-b398-0f3f67159a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43beed7e-5952-4cc8-89ea-8c819ceb44de", "tag": "009f1a65-b949-4493-a4fc-88ecafb96c71"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:16.459072 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-e0395fdc-15aa-4b52-85a8-c27410c64231 req-57c15225-0d82-4d9a-b398-0f3f67159a69 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:16.459856 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-e0395fdc-15aa-4b52-85a8-c27410c64231 req-57c15225-0d82-4d9a-b398-0f3f67159a69 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:16.489711 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-e0395fdc-15aa-4b52-85a8-c27410c64231 req-57c15225-0d82-4d9a-b398-0f3f67159a69 service nova] Creating event network-changed:009f1a65-b949-4493-a4fc-88ecafb96c71 for instance 43beed7e-5952-4cc8-89ea-8c819ceb44de on hv-cinder-83124 Jun 03 15:31:16.508707 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-e0395fdc-15aa-4b52-85a8-c27410c64231 req-57c15225-0d82-4d9a-b398-0f3f67159a69 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067341 Jun 03 15:31:16.509476 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 312/613] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:16.795178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a0633229-1be8-40d3-99e3-6ad0e92b9b85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:16.795787 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a0633229-1be8-40d3-99e3-6ad0e92b9b85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] [instance: 67f284eb-df90-4337-8bdf-511156b6a756] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:16.802306 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a0633229-1be8-40d3-99e3-6ad0e92b9b85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:16.802782 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a0633229-1be8-40d3-99e3-6ad0e92b9b85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:16.803544 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a0633229-1be8-40d3-99e3-6ad0e92b9b85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:16.803975 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a0633229-1be8-40d3-99e3-6ad0e92b9b85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:16.817816 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-a0633229-1be8-40d3-99e3-6ad0e92b9b85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] HTTP exception thrown: Instance 67f284eb-df90-4337-8bdf-511156b6a756 could not be found. Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a0633229-1be8-40d3-99e3-6ad0e92b9b85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Request method failure captured: Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 HTTP/1.1 Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimihnw6pUHNgqPxgdy9D5ND4Yd0hpS68DbJJvzfHyb1aIv33pR9eqQ0-XB79Zb_NF37KAT9kbV-HT8F18omzrZ8wkGwrqW9GV_Kr7r3npBSuhrh5PZSKRbXvg3uHGFZKFjFv-HIAHlQLkwqLjc3sFZl6vdnD2AzhHzM-NxCre2iqCsT8 Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 00d2022cc4be4779af1edf1520c439ae Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-TestMinimumBasicScenario-1235430946 Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:31:16.819477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00d2022cc4be4779af1edf1520c439ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00d2022cc4be4779af1edf1520c439ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00d2022cc4be4779af1edf1520c439ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00d2022cc4be4779af1edf1520c439ae"}]}] Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-TestMinimumBasicScenario-1235430946 Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 00d2022cc4be4779af1edf1520c439ae Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1235430946 Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-TestMinimumBasicScenario-1235430946-project Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: dac7f01263374a2cbdd892a2513f5ecd Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-TestMinimumBasicScenario-1235430946-project Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 67f284eb-df90-4337-8bdf-511156b6a756 could not be found. Jun 03 15:31:16.821029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '67f284eb-df90-4337-8bdf-511156b6a756'} Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f284eb-df90-4337-8bdf-511156b6a756 could not be found. Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:31:16.821799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f284eb-df90-4337-8bdf-511156b6a756 could not be found. Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f284eb-df90-4337-8bdf-511156b6a756 could not be found. Jun 03 15:31:16.823023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:31:16.824117 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a0633229-1be8-40d3-99e3-6ad0e92b9b85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Returning 404 to user: Instance 67f284eb-df90-4337-8bdf-511156b6a756 could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:31:16.824117 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a0633229-1be8-40d3-99e3-6ad0e92b9b85 tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756" status: 404 len: 111 microversion: 2.1 time: 0.029495 Jun 03 15:31:16.824117 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 302/614] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:16 2022] GET /compute/v2.1/servers/67f284eb-df90-4337-8bdf-511156b6a756 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:31:16.830570 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9d8df473-d3ae-4dae-9845-5af2e8c119ee tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] Calling method '.version_select at 0x7f92f0bcc4c0>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:16.848783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9d8df473-d3ae-4dae-9845-5af2e8c119ee tempest-TestMinimumBasicScenario-1235430946 tempest-TestMinimumBasicScenario-1235430946-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-674887491" status: 202 len: 0 microversion: 2.1 time: 0.022756 Jun 03 15:31:16.849370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 313/615] 10.222.0.93 () {58 vars in 1268 bytes} [Fri Jun 3 15:31:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-674887491 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:31:16.929502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-22a87be1-42ac-4b4b-8ba7-15bfdea4a6c9 req-a424e4c9-24f8-4e3d-95d8-f544a0e6bdcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f284eb-df90-4337-8bdf-511156b6a756", "name": "network-vif-deleted", "tag": "3013216d-76f3-469e-9c86-a0bc71687991"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:16.938860 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-22a87be1-42ac-4b4b-8ba7-15bfdea4a6c9 req-a424e4c9-24f8-4e3d-95d8-f544a0e6bdcc service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:16.939004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-22a87be1-42ac-4b4b-8ba7-15bfdea4a6c9 req-a424e4c9-24f8-4e3d-95d8-f544a0e6bdcc service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:16.950804 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-22a87be1-42ac-4b4b-8ba7-15bfdea4a6c9 req-a424e4c9-24f8-4e3d-95d8-f544a0e6bdcc service nova] Creating event network-vif-deleted:3013216d-76f3-469e-9c86-a0bc71687991 for instance 67f284eb-df90-4337-8bdf-511156b6a756 on hv-cinder-83124 Jun 03 15:31:16.957297 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-22a87be1-42ac-4b4b-8ba7-15bfdea4a6c9 req-a424e4c9-24f8-4e3d-95d8-f544a0e6bdcc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030619 Jun 03 15:31:16.957297 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 303/616] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:31:17.343334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d0791d5a-ab50-43c5-ab56-f7518a785442 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:17.344092 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d0791d5a-ab50-43c5-ab56-f7518a785442 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:17.350618 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d0791d5a-ab50-43c5-ab56-f7518a785442 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:17.351073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d0791d5a-ab50-43c5-ab56-f7518a785442 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:17.351879 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d0791d5a-ab50-43c5-ab56-f7518a785442 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:17.352322 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d0791d5a-ab50-43c5-ab56-f7518a785442 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:17.637347 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d0791d5a-ab50-43c5-ab56-f7518a785442 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:17.646154 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d0791d5a-ab50-43c5-ab56-f7518a785442 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:17.648233 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d0791d5a-ab50-43c5-ab56-f7518a785442 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:17.649415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d0791d5a-ab50-43c5-ab56-f7518a785442 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1405 microversion: 2.20 time: 0.309654 Jun 03 15:31:17.650154 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 314/617] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:17 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:18.684342 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-142d7ce8-a44f-4d34-ad7f-469324322c32 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:18.685874 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-142d7ce8-a44f-4d34-ad7f-469324322c32 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:18.696026 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-142d7ce8-a44f-4d34-ad7f-469324322c32 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:18.697665 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-142d7ce8-a44f-4d34-ad7f-469324322c32 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:18.698853 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-142d7ce8-a44f-4d34-ad7f-469324322c32 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:18.699523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-142d7ce8-a44f-4d34-ad7f-469324322c32 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:18.936350 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-142d7ce8-a44f-4d34-ad7f-469324322c32 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:18.945319 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-142d7ce8-a44f-4d34-ad7f-469324322c32 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:18.947134 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-142d7ce8-a44f-4d34-ad7f-469324322c32 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:18.948303 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-142d7ce8-a44f-4d34-ad7f-469324322c32 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1405 microversion: 2.20 time: 0.270329 Jun 03 15:31:18.948798 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 304/618] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:18 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1405 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:19.967356 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2005baaa-3804-4118-9f27-6509e1a9fbf5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:19.969729 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2005baaa-3804-4118-9f27-6509e1a9fbf5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:19.984216 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2005baaa-3804-4118-9f27-6509e1a9fbf5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:19.984674 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2005baaa-3804-4118-9f27-6509e1a9fbf5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:19.986410 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2005baaa-3804-4118-9f27-6509e1a9fbf5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:19.986879 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2005baaa-3804-4118-9f27-6509e1a9fbf5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:20.303242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2005baaa-3804-4118-9f27-6509e1a9fbf5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:20.311844 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2005baaa-3804-4118-9f27-6509e1a9fbf5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:20.313622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2005baaa-3804-4118-9f27-6509e1a9fbf5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:20.314983 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2005baaa-3804-4118-9f27-6509e1a9fbf5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1405 microversion: 2.20 time: 0.351960 Jun 03 15:31:20.315626 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 315/619] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:19 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1405 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:21.332482 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c6e136ed-3aac-46a9-ba1f-1b59b42e0fa3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:21.333066 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c6e136ed-3aac-46a9-ba1f-1b59b42e0fa3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:21.340335 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6e136ed-3aac-46a9-ba1f-1b59b42e0fa3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:21.340786 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6e136ed-3aac-46a9-ba1f-1b59b42e0fa3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:21.341759 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6e136ed-3aac-46a9-ba1f-1b59b42e0fa3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:21.342192 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6e136ed-3aac-46a9-ba1f-1b59b42e0fa3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:21.584660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-14200e4e-e489-480a-849f-f7995a7fd4fb req-63132e73-003f-496c-bac7-23854fc7b861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43beed7e-5952-4cc8-89ea-8c819ceb44de", "name": "network-vif-plugged", "status": "completed", "tag": "009f1a65-b949-4493-a4fc-88ecafb96c71"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:21.590334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:21.591625 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=12 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:21.598084 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-14200e4e-e489-480a-849f-f7995a7fd4fb req-63132e73-003f-496c-bac7-23854fc7b861 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:21.598799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-14200e4e-e489-480a-849f-f7995a7fd4fb req-63132e73-003f-496c-bac7-23854fc7b861 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:21.776503 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-14200e4e-e489-480a-849f-f7995a7fd4fb req-63132e73-003f-496c-bac7-23854fc7b861 service nova] Creating event network-vif-plugged:009f1a65-b949-4493-a4fc-88ecafb96c71 for instance 43beed7e-5952-4cc8-89ea-8c819ceb44de on hv-cinder-83124 Jun 03 15:31:21.783323 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-14200e4e-e489-480a-849f-f7995a7fd4fb req-63132e73-003f-496c-bac7-23854fc7b861 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202886 Jun 03 15:31:21.784840 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 316/620] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:21.812820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c6e136ed-3aac-46a9-ba1f-1b59b42e0fa3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:21.823498 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c6e136ed-3aac-46a9-ba1f-1b59b42e0fa3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:21.825012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c6e136ed-3aac-46a9-ba1f-1b59b42e0fa3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:21.826604 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c6e136ed-3aac-46a9-ba1f-1b59b42e0fa3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1405 microversion: 2.20 time: 0.498062 Jun 03 15:31:21.830590 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 305/621] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:21 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1405 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:22.846956 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c350f8c4-1cbc-44de-9003-1964a6af7f28 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:22.847651 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c350f8c4-1cbc-44de-9003-1964a6af7f28 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:22.849604 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:22.855097 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c350f8c4-1cbc-44de-9003-1964a6af7f28 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:22.855546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c350f8c4-1cbc-44de-9003-1964a6af7f28 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:22.856317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c350f8c4-1cbc-44de-9003-1964a6af7f28 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:22.856750 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c350f8c4-1cbc-44de-9003-1964a6af7f28 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:23.004396 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c350f8c4-1cbc-44de-9003-1964a6af7f28 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:23.014861 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c350f8c4-1cbc-44de-9003-1964a6af7f28 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:23.017255 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c350f8c4-1cbc-44de-9003-1964a6af7f28 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:23.018403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c350f8c4-1cbc-44de-9003-1964a6af7f28 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1405 microversion: 2.20 time: 0.176973 Jun 03 15:31:23.020593 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 317/622] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:22 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:31:24.037264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7f795b23-8776-404a-b250-27fbad680ec2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:24.038398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7f795b23-8776-404a-b250-27fbad680ec2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:24.040898 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:24.051617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7f795b23-8776-404a-b250-27fbad680ec2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:24.056214 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7f795b23-8776-404a-b250-27fbad680ec2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:24.057064 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7f795b23-8776-404a-b250-27fbad680ec2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:24.057507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7f795b23-8776-404a-b250-27fbad680ec2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:24.306407 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7f795b23-8776-404a-b250-27fbad680ec2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:24.321282 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7f795b23-8776-404a-b250-27fbad680ec2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:24.325832 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7f795b23-8776-404a-b250-27fbad680ec2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:24.327376 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7f795b23-8776-404a-b250-27fbad680ec2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1405 microversion: 2.20 time: 0.293967 Jun 03 15:31:24.337816 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 306/623] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:24 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:25.345935 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-77e23b29-f3f9-4d6f-87c9-ca92a51707c7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:25.346550 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-77e23b29-f3f9-4d6f-87c9-ca92a51707c7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:25.353865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-77e23b29-f3f9-4d6f-87c9-ca92a51707c7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:25.353865 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-77e23b29-f3f9-4d6f-87c9-ca92a51707c7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:25.354648 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-77e23b29-f3f9-4d6f-87c9-ca92a51707c7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:25.355050 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-77e23b29-f3f9-4d6f-87c9-ca92a51707c7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:25.513212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-77e23b29-f3f9-4d6f-87c9-ca92a51707c7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:25.523587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-77e23b29-f3f9-4d6f-87c9-ca92a51707c7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:25.525099 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-77e23b29-f3f9-4d6f-87c9-ca92a51707c7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:25.526265 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-77e23b29-f3f9-4d6f-87c9-ca92a51707c7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1598 microversion: 2.20 time: 0.184896 Jun 03 15:31:25.527164 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 318/624] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:31:25 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1598 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:31:25.546939 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a4c64c5e-c17d-46d1-bd57-854aa48033dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:25.548965 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a4c64c5e-c17d-46d1-bd57-854aa48033dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:25.556054 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a4c64c5e-c17d-46d1-bd57-854aa48033dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:25.556612 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a4c64c5e-c17d-46d1-bd57-854aa48033dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:25.557435 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a4c64c5e-c17d-46d1-bd57-854aa48033dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:25.557864 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a4c64c5e-c17d-46d1-bd57-854aa48033dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:25.639903 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a4c64c5e-c17d-46d1-bd57-854aa48033dc tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097144 Jun 03 15:31:25.641474 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 307/625] 10.222.0.93 () {60 vars in 1315 bytes} [Fri Jun 3 15:31:25 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:31:26.884240 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-b8ce4591-341d-459a-abf1-0919ccbd38e4 req-8fb56678-94b2-4da0-bb4f-631e770c2b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43beed7e-5952-4cc8-89ea-8c819ceb44de", "tag": "009f1a65-b949-4493-a4fc-88ecafb96c71"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:26.896285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-b8ce4591-341d-459a-abf1-0919ccbd38e4 req-8fb56678-94b2-4da0-bb4f-631e770c2b0c service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:26.896842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-b8ce4591-341d-459a-abf1-0919ccbd38e4 req-8fb56678-94b2-4da0-bb4f-631e770c2b0c service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:26.911954 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-b8ce4591-341d-459a-abf1-0919ccbd38e4 req-8fb56678-94b2-4da0-bb4f-631e770c2b0c service nova] Creating event network-changed:009f1a65-b949-4493-a4fc-88ecafb96c71 for instance 43beed7e-5952-4cc8-89ea-8c819ceb44de on hv-cinder-83124 Jun 03 15:31:26.919320 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-b8ce4591-341d-459a-abf1-0919ccbd38e4 req-8fb56678-94b2-4da0-bb4f-631e770c2b0c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038635 Jun 03 15:31:26.920035 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 319/626] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:31:35.241633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1efb7c81-d96b-49f0-9663-f1f478d6e5b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:35.243017 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1efb7c81-d96b-49f0-9663-f1f478d6e5b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:35.250446 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1efb7c81-d96b-49f0-9663-f1f478d6e5b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:35.251784 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1efb7c81-d96b-49f0-9663-f1f478d6e5b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:35.253021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1efb7c81-d96b-49f0-9663-f1f478d6e5b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:35.253458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1efb7c81-d96b-49f0-9663-f1f478d6e5b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:35.320458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1efb7c81-d96b-49f0-9663-f1f478d6e5b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/ips" status: 200 len: 151 microversion: 2.1 time: 0.083494 Jun 03 15:31:35.328532 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 308/627] 10.222.0.93 () {58 vars in 1247 bytes} [Fri Jun 3 15:31:35 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/ips => generated 151 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:35.842353 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-88816cce-db00-450f-9237-e34827c0cddc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:35.843276 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-88816cce-db00-450f-9237-e34827c0cddc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:35.862141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-88816cce-db00-450f-9237-e34827c0cddc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:35.863496 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-88816cce-db00-450f-9237-e34827c0cddc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:35.864549 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-88816cce-db00-450f-9237-e34827c0cddc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:35.865184 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-88816cce-db00-450f-9237-e34827c0cddc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:35.937906 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-88816cce-db00-450f-9237-e34827c0cddc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lazy-loading 'flavor' on Instance uuid 800d0eab-3550-4b55-8837-765681285f77 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:31:36.096170 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-88816cce-db00-450f-9237-e34827c0cddc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "POST /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77/action" status: 202 len: 0 microversion: 2.1 time: 0.257675 Jun 03 15:31:36.097400 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 320/628] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:31:35 2022] POST /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:31:36.106694 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-579c288f-4ab1-46c6-8c95-81dee6d8e5fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:36.107509 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-579c288f-4ab1-46c6-8c95-81dee6d8e5fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:36.123059 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-579c288f-4ab1-46c6-8c95-81dee6d8e5fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:36.123703 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-579c288f-4ab1-46c6-8c95-81dee6d8e5fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:36.126149 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-579c288f-4ab1-46c6-8c95-81dee6d8e5fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:36.128518 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-579c288f-4ab1-46c6-8c95-81dee6d8e5fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:36.322807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-579c288f-4ab1-46c6-8c95-81dee6d8e5fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:36.335113 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-579c288f-4ab1-46c6-8c95-81dee6d8e5fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.232411 Jun 03 15:31:36.337205 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 309/629] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:36 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:36.817442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-35043894-e389-454e-9b20-1ba281a6a162 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d143efa4-0763-4f72-9000-c580ebba7696"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:36.820204 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-35043894-e389-454e-9b20-1ba281a6a162 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:36.828271 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-35043894-e389-454e-9b20-1ba281a6a162 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:36.829503 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-35043894-e389-454e-9b20-1ba281a6a162 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:36.830492 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-35043894-e389-454e-9b20-1ba281a6a162 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:36.831155 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-35043894-e389-454e-9b20-1ba281a6a162 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:37.269155 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2da4c02d-5312-4e47-a30b-c4104fb76d8e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Action: 'create', calling method: .version_select at 0x7f92f0c30a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1350769796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3EkYsgIrEWLF7peV9KmUOBE+g7TzwjIoTDJlbrmzWXWwzWBStCvTI7Ms7sa9Rtz2YlSuYS4QKjfUQ2IZ0tbZ31fqP+bb7Nt16fesaMQoCs1dHc2zUmuuSI7sZ8T8DeVw=="}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:37.286428 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-2da4c02d-5312-4e47-a30b-c4104fb76d8e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Getting quotas for project 141bd2be69f243aa926f28b96eb6f0d5. Resources: {'key_pairs'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:31:37.291547 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-2da4c02d-5312-4e47-a30b-c4104fb76d8e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Getting quotas for user 7d53405e3f88439f81b67106ad98adc2 and project 141bd2be69f243aa926f28b96eb6f0d5. Resources: {'key_pairs'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:31:37.324988 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2da4c02d-5312-4e47-a30b-c4104fb76d8e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.281759 Jun 03 15:31:37.327067 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 310/630] 10.222.0.93 () {60 vars in 1158 bytes} [Fri Jun 3 15:31:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:37.353485 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-26df1107-ad4b-4b04-a7d3-7a97067c461c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:37.354292 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-26df1107-ad4b-4b04-a7d3-7a97067c461c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:37.362008 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-26df1107-ad4b-4b04-a7d3-7a97067c461c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:37.362725 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-26df1107-ad4b-4b04-a7d3-7a97067c461c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:37.363726 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-26df1107-ad4b-4b04-a7d3-7a97067c461c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:37.364492 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-26df1107-ad4b-4b04-a7d3-7a97067c461c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:37.490441 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-35043894-e389-454e-9b20-1ba281a6a162 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681058 Jun 03 15:31:37.512148 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 321/631] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:31:36 2022] POST /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:37.770288 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-26df1107-ad4b-4b04-a7d3-7a97067c461c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:37.780044 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-26df1107-ad4b-4b04-a7d3-7a97067c461c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.430793 Jun 03 15:31:37.780793 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 311/632] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:37 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:38.816909 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ebc7aea3-66a9-40d0-8fa6-10c36a02b416 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:38.817614 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ebc7aea3-66a9-40d0-8fa6-10c36a02b416 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:38.831092 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ebc7aea3-66a9-40d0-8fa6-10c36a02b416 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:38.831936 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ebc7aea3-66a9-40d0-8fa6-10c36a02b416 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:38.833220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ebc7aea3-66a9-40d0-8fa6-10c36a02b416 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:38.836028 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ebc7aea3-66a9-40d0-8fa6-10c36a02b416 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:39.037134 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ebc7aea3-66a9-40d0-8fa6-10c36a02b416 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:39.046004 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ebc7aea3-66a9-40d0-8fa6-10c36a02b416 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.246120 Jun 03 15:31:39.046800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 322/633] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:38 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:40.064580 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e7015501-3b2d-4381-989b-5d897e0f2b85 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:40.066233 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e7015501-3b2d-4381-989b-5d897e0f2b85 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:40.074132 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e7015501-3b2d-4381-989b-5d897e0f2b85 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:40.074625 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e7015501-3b2d-4381-989b-5d897e0f2b85 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:40.075516 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e7015501-3b2d-4381-989b-5d897e0f2b85 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:40.076125 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e7015501-3b2d-4381-989b-5d897e0f2b85 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:40.253198 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e7015501-3b2d-4381-989b-5d897e0f2b85 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:40.264553 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e7015501-3b2d-4381-989b-5d897e0f2b85 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.204037 Jun 03 15:31:40.265650 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 312/634] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:40 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:41.283814 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-217ca487-2b77-43e5-bfa1-1c7146fcc0eb tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:41.284451 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-217ca487-2b77-43e5-bfa1-1c7146fcc0eb tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:41.291780 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-217ca487-2b77-43e5-bfa1-1c7146fcc0eb tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:41.292227 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-217ca487-2b77-43e5-bfa1-1c7146fcc0eb tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:41.293008 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-217ca487-2b77-43e5-bfa1-1c7146fcc0eb tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:41.293443 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-217ca487-2b77-43e5-bfa1-1c7146fcc0eb tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:41.447260 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-217ca487-2b77-43e5-bfa1-1c7146fcc0eb tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:41.455903 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-217ca487-2b77-43e5-bfa1-1c7146fcc0eb tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.175816 Jun 03 15:31:41.456548 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 323/635] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:41 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:42.473825 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1d77d80a-e203-4ca9-8223-613b090d993b tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:42.474440 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1d77d80a-e203-4ca9-8223-613b090d993b tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:42.481190 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d77d80a-e203-4ca9-8223-613b090d993b tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:42.481636 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d77d80a-e203-4ca9-8223-613b090d993b tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:42.482415 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d77d80a-e203-4ca9-8223-613b090d993b tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:42.482884 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d77d80a-e203-4ca9-8223-613b090d993b tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:42.631618 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-1d77d80a-e203-4ca9-8223-613b090d993b tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:42.640155 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1d77d80a-e203-4ca9-8223-613b090d993b tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.169869 Jun 03 15:31:42.641507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 313/636] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:42 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:43.659528 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-018a669f-98cb-4efc-a8b3-8401878c76fd tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:43.660173 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-018a669f-98cb-4efc-a8b3-8401878c76fd tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:43.667233 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-018a669f-98cb-4efc-a8b3-8401878c76fd tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:43.667762 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-018a669f-98cb-4efc-a8b3-8401878c76fd tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:43.668632 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-018a669f-98cb-4efc-a8b3-8401878c76fd tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:43.669244 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-018a669f-98cb-4efc-a8b3-8401878c76fd tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:43.825010 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-018a669f-98cb-4efc-a8b3-8401878c76fd tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:43.835317 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-018a669f-98cb-4efc-a8b3-8401878c76fd tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.180160 Jun 03 15:31:43.835894 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 324/637] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:43 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:44.855647 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-29ddf3ce-56e8-47a5-b2fd-5b9ccfca85b8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:44.856268 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-29ddf3ce-56e8-47a5-b2fd-5b9ccfca85b8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:44.866376 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29ddf3ce-56e8-47a5-b2fd-5b9ccfca85b8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:44.867035 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29ddf3ce-56e8-47a5-b2fd-5b9ccfca85b8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:44.867859 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29ddf3ce-56e8-47a5-b2fd-5b9ccfca85b8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:44.868407 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29ddf3ce-56e8-47a5-b2fd-5b9ccfca85b8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:45.023989 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-29ddf3ce-56e8-47a5-b2fd-5b9ccfca85b8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:45.034409 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-29ddf3ce-56e8-47a5-b2fd-5b9ccfca85b8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.184548 Jun 03 15:31:45.035033 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 314/638] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:44 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:45.126288 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-02d09acc-712a-4064-af65-b1ecfa9da1d3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d143efa4-0763-4f72-9000-c580ebba7696"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:45.127454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-02d09acc-712a-4064-af65-b1ecfa9da1d3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:45.134169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-02d09acc-712a-4064-af65-b1ecfa9da1d3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:45.134657 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-02d09acc-712a-4064-af65-b1ecfa9da1d3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:45.135439 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-02d09acc-712a-4064-af65-b1ecfa9da1d3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:45.135880 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-02d09acc-712a-4064-af65-b1ecfa9da1d3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:45.138512 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:45.239014 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-02d09acc-712a-4064-af65-b1ecfa9da1d3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Invalid volume: volume d143efa4-0763-4f72-9000-c580ebba7696 is already attached to instances: d49a8a8d-d24d-42e9-8a4d-775920a378aa Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-02d09acc-712a-4064-af65-b1ecfa9da1d3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: POST /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments HTTP/1.1 Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 74 Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:31:45.240804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {"volumeAttachment": {"volumeId": "d143efa4-0763-4f72-9000-c580ebba7696"}} Jun 03 15:31:45.242564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Invalid volume: volume d143efa4-0763-4f72-9000-c580ebba7696 is already attached to instances: d49a8a8d-d24d-42e9-8a4d-775920a378aa Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'server_id': 'd49a8a8d-d24d-42e9-8a4d-775920a378aa', 'body': {'volumeAttachment': {'volumeId': 'd143efa4-0763-4f72-9000-c580ebba7696'}}} Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d143efa4-0763-4f72-9000-c580ebba7696 is already attached to instances: d49a8a8d-d24d-42e9-8a4d-775920a378aa Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:45.246749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d143efa4-0763-4f72-9000-c580ebba7696 is already attached to instances: d49a8a8d-d24d-42e9-8a4d-775920a378aa Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:45.247989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:45.249188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:45.249188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:31:45.249188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:31:45.249188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d143efa4-0763-4f72-9000-c580ebba7696 is already attached to instances: d49a8a8d-d24d-42e9-8a4d-775920a378aa Jun 03 15:31:45.249188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:45.249188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-02d09acc-712a-4064-af65-b1ecfa9da1d3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 400 to user: Invalid volume: volume d143efa4-0763-4f72-9000-c580ebba7696 is already attached to instances: d49a8a8d-d24d-42e9-8a4d-775920a378aa {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:31:45.249188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-02d09acc-712a-4064-af65-b1ecfa9da1d3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121082 Jun 03 15:31:45.249188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 325/639] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:31:45 2022] POST /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:31:45.313329 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cc915643-daba-4f75-9fe6-be86f3f2d577 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:45.313828 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-cc915643-daba-4f75-9fe6-be86f3f2d577 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:45.321326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc915643-daba-4f75-9fe6-be86f3f2d577 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:45.321774 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc915643-daba-4f75-9fe6-be86f3f2d577 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:45.322653 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc915643-daba-4f75-9fe6-be86f3f2d577 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:45.323108 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc915643-daba-4f75-9fe6-be86f3f2d577 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:45.421105 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-cc915643-daba-4f75-9fe6-be86f3f2d577 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lazy-loading 'services' on Instance uuid d49a8a8d-d24d-42e9-8a4d-775920a378aa {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:31:45.509958 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-cc915643-daba-4f75-9fe6-be86f3f2d577 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments/d143efa4-0763-4f72-9000-c580ebba7696" status: 202 len: 0 microversion: 2.1 time: 0.200810 Jun 03 15:31:45.510658 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 315/640] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:31:45 2022] DELETE /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments/d143efa4-0763-4f72-9000-c580ebba7696 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 15:31:45.519329 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1eb43b11-647a-40f1-b6ff-03ad5e338a99 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:45.520296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1eb43b11-647a-40f1-b6ff-03ad5e338a99 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:45.526547 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1eb43b11-647a-40f1-b6ff-03ad5e338a99 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:45.527413 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1eb43b11-647a-40f1-b6ff-03ad5e338a99 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:45.528036 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1eb43b11-647a-40f1-b6ff-03ad5e338a99 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:45.528621 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1eb43b11-647a-40f1-b6ff-03ad5e338a99 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:45.564106 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1eb43b11-647a-40f1-b6ff-03ad5e338a99 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048669 Jun 03 15:31:45.564805 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 326/641] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:45 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:31:46.055972 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7e008c38-c13d-4127-a02d-53fb7334d69d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:46.056709 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7e008c38-c13d-4127-a02d-53fb7334d69d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:46.064364 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7e008c38-c13d-4127-a02d-53fb7334d69d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:46.064902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7e008c38-c13d-4127-a02d-53fb7334d69d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:46.065790 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7e008c38-c13d-4127-a02d-53fb7334d69d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:46.066229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7e008c38-c13d-4127-a02d-53fb7334d69d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:46.225503 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7e008c38-c13d-4127-a02d-53fb7334d69d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:46.227981 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:46.235283 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7e008c38-c13d-4127-a02d-53fb7334d69d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.184176 Jun 03 15:31:46.235882 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 316/642] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:46 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:46.576551 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b8cfee42-6053-483d-b583-3ee91db7bc46 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:46.577584 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b8cfee42-6053-483d-b583-3ee91db7bc46 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:46.584308 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b8cfee42-6053-483d-b583-3ee91db7bc46 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:46.584752 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b8cfee42-6053-483d-b583-3ee91db7bc46 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:46.585513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b8cfee42-6053-483d-b583-3ee91db7bc46 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:46.585939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b8cfee42-6053-483d-b583-3ee91db7bc46 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:46.614868 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b8cfee42-6053-483d-b583-3ee91db7bc46 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042413 Jun 03 15:31:46.615414 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 327/643] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:46 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 15:31:46.676695 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-20b494ff-2d48-4dba-83dc-1a0aaaab8f33 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:46.677637 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-20b494ff-2d48-4dba-83dc-1a0aaaab8f33 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:46.683940 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20b494ff-2d48-4dba-83dc-1a0aaaab8f33 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:46.684396 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20b494ff-2d48-4dba-83dc-1a0aaaab8f33 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:46.685204 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20b494ff-2d48-4dba-83dc-1a0aaaab8f33 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:46.685658 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20b494ff-2d48-4dba-83dc-1a0aaaab8f33 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:46.709804 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-20b494ff-2d48-4dba-83dc-1a0aaaab8f33 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:31:46.791829 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-20b494ff-2d48-4dba-83dc-1a0aaaab8f33 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 204 len: 0 microversion: 2.1 time: 0.121061 Jun 03 15:31:46.792612 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 317/644] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:31:46 2022] DELETE /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:31:46.801960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-49454f2d-2d19-44f1-9613-0d4df6559727 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:46.802727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-49454f2d-2d19-44f1-9613-0d4df6559727 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:46.809436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-49454f2d-2d19-44f1-9613-0d4df6559727 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:46.809881 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-49454f2d-2d19-44f1-9613-0d4df6559727 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:46.810701 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-49454f2d-2d19-44f1-9613-0d4df6559727 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:46.811155 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-49454f2d-2d19-44f1-9613-0d4df6559727 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:46.943926 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-49454f2d-2d19-44f1-9613-0d4df6559727 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:46.951430 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-49454f2d-2d19-44f1-9613-0d4df6559727 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1681 microversion: 2.1 time: 0.154103 Jun 03 15:31:46.952018 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 328/645] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:46 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:47.252909 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1d538ae6-8bb8-4b48-8f5a-16de8fa7fbca tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:47.253666 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1d538ae6-8bb8-4b48-8f5a-16de8fa7fbca tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:47.260908 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d538ae6-8bb8-4b48-8f5a-16de8fa7fbca tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:47.261420 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d538ae6-8bb8-4b48-8f5a-16de8fa7fbca tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:47.262213 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d538ae6-8bb8-4b48-8f5a-16de8fa7fbca tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:47.262711 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d538ae6-8bb8-4b48-8f5a-16de8fa7fbca tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:47.302949 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=4 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:47.399371 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-1d538ae6-8bb8-4b48-8f5a-16de8fa7fbca tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:47.407989 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1d538ae6-8bb8-4b48-8f5a-16de8fa7fbca tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.159372 Jun 03 15:31:47.408649 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 318/646] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:47 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:47.969296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-86285f11-aa87-4dbd-967e-672829145ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:47.969923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-86285f11-aa87-4dbd-967e-672829145ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:47.976462 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-86285f11-aa87-4dbd-967e-672829145ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:47.976910 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-86285f11-aa87-4dbd-967e-672829145ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:47.977669 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-86285f11-aa87-4dbd-967e-672829145ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:47.978103 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-86285f11-aa87-4dbd-967e-672829145ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:48.112801 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-86285f11-aa87-4dbd-967e-672829145ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:48.120715 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-86285f11-aa87-4dbd-967e-672829145ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1681 microversion: 2.1 time: 0.155216 Jun 03 15:31:48.121224 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 329/647] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:47 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:48.425922 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d4a07eac-18e3-46a2-933d-9342be1d2897 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:48.426444 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d4a07eac-18e3-46a2-933d-9342be1d2897 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:48.433001 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d4a07eac-18e3-46a2-933d-9342be1d2897 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:48.433455 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d4a07eac-18e3-46a2-933d-9342be1d2897 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:48.434224 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d4a07eac-18e3-46a2-933d-9342be1d2897 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:48.434706 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d4a07eac-18e3-46a2-933d-9342be1d2897 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:48.567128 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d4a07eac-18e3-46a2-933d-9342be1d2897 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:48.574846 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d4a07eac-18e3-46a2-933d-9342be1d2897 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.153476 Jun 03 15:31:48.575417 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 319/648] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:48 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:49.146546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9ef03b13-572e-4174-ae41-3e93d846f629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:49.147182 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9ef03b13-572e-4174-ae41-3e93d846f629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:49.156273 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9ef03b13-572e-4174-ae41-3e93d846f629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.157364 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9ef03b13-572e-4174-ae41-3e93d846f629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.158427 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9ef03b13-572e-4174-ae41-3e93d846f629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.158890 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9ef03b13-572e-4174-ae41-3e93d846f629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.306059 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9ef03b13-572e-4174-ae41-3e93d846f629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:49.333414 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9ef03b13-572e-4174-ae41-3e93d846f629 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1681 microversion: 2.1 time: 0.199095 Jun 03 15:31:49.333989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 330/649] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:49 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:49.368815 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-745f37a3-2379-433b-b085-6e0de1dc80f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:49.369965 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-745f37a3-2379-433b-b085-6e0de1dc80f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:49.378689 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-745f37a3-2379-433b-b085-6e0de1dc80f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.379138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-745f37a3-2379-433b-b085-6e0de1dc80f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.380222 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-745f37a3-2379-433b-b085-6e0de1dc80f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.380825 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-745f37a3-2379-433b-b085-6e0de1dc80f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.412276 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-745f37a3-2379-433b-b085-6e0de1dc80f3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047554 Jun 03 15:31:49.412842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 320/650] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:49 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 15:31:49.481591 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-be83b85d-aaaf-4e18-8dd6-bed46f528ce6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:49.482140 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-be83b85d-aaaf-4e18-8dd6-bed46f528ce6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:49.488415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-be83b85d-aaaf-4e18-8dd6-bed46f528ce6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.488906 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-be83b85d-aaaf-4e18-8dd6-bed46f528ce6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.489716 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-be83b85d-aaaf-4e18-8dd6-bed46f528ce6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.490185 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-be83b85d-aaaf-4e18-8dd6-bed46f528ce6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.515039 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-be83b85d-aaaf-4e18-8dd6-bed46f528ce6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Going to try to terminate instance {{(pid=117806) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:31:49.592885 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ea70faed-a43d-4f2d-9b81-c6d0ec8804a8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:49.596882 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ea70faed-a43d-4f2d-9b81-c6d0ec8804a8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:49.612872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ea70faed-a43d-4f2d-9b81-c6d0ec8804a8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.612872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ea70faed-a43d-4f2d-9b81-c6d0ec8804a8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.612872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ea70faed-a43d-4f2d-9b81-c6d0ec8804a8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.612872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ea70faed-a43d-4f2d-9b81-c6d0ec8804a8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.642948 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-be83b85d-aaaf-4e18-8dd6-bed46f528ce6 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 204 len: 0 microversion: 2.1 time: 0.164343 Jun 03 15:31:49.643987 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 331/651] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:31:49 2022] DELETE /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:31:49.662947 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-ed273110-1a76-44d6-9be3-29d722162fb5 req-9393848e-fee5-494b-8672-920731929690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49a8a8d-d24d-42e9-8a4d-775920a378aa", "name": "network-vif-deleted", "tag": "d0141bfc-60f8-4d27-ac11-5366f93320f4"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:49.679634 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-ed273110-1a76-44d6-9be3-29d722162fb5 req-9393848e-fee5-494b-8672-920731929690 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.680336 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-ed273110-1a76-44d6-9be3-29d722162fb5 req-9393848e-fee5-494b-8672-920731929690 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.696799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-ed273110-1a76-44d6-9be3-29d722162fb5 req-9393848e-fee5-494b-8672-920731929690 service nova] Creating event network-vif-deleted:d0141bfc-60f8-4d27-ac11-5366f93320f4 for instance d49a8a8d-d24d-42e9-8a4d-775920a378aa on hv-cinder-83124 Jun 03 15:31:49.707141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-ed273110-1a76-44d6-9be3-29d722162fb5 req-9393848e-fee5-494b-8672-920731929690 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061693 Jun 03 15:31:49.708049 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 332/652] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:49.713609 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-115c4d76-4696-4929-bd1e-020657c23580 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:49.714316 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-115c4d76-4696-4929-bd1e-020657c23580 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:49.721731 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-115c4d76-4696-4929-bd1e-020657c23580 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.722325 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-115c4d76-4696-4929-bd1e-020657c23580 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.723252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-115c4d76-4696-4929-bd1e-020657c23580 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:49.723694 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-115c4d76-4696-4929-bd1e-020657c23580 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:49.831151 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ea70faed-a43d-4f2d-9b81-c6d0ec8804a8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:49.839479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ea70faed-a43d-4f2d-9b81-c6d0ec8804a8 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.250852 Jun 03 15:31:49.850447 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 321/653] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:49 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:31:49.887222 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-115c4d76-4696-4929-bd1e-020657c23580 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:49.896116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-115c4d76-4696-4929-bd1e-020657c23580 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1672 microversion: 2.1 time: 0.186712 Jun 03 15:31:49.897190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 333/654] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:49 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:50.349955 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2bacc823-650a-4840-a259-35e9ba256ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:50.350626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2bacc823-650a-4840-a259-35e9ba256ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:50.356775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2bacc823-650a-4840-a259-35e9ba256ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:50.357222 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2bacc823-650a-4840-a259-35e9ba256ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:50.357984 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2bacc823-650a-4840-a259-35e9ba256ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:50.358422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2bacc823-650a-4840-a259-35e9ba256ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:50.424240 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2bacc823-650a-4840-a259-35e9ba256ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:50.432046 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2bacc823-650a-4840-a259-35e9ba256ed4 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1614 microversion: 2.1 time: 0.085950 Jun 03 15:31:50.432738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 322/655] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:50 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:50.856808 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-419d08eb-9fc0-4210-aad0-10d3aadfb0a3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:50.857424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-419d08eb-9fc0-4210-aad0-10d3aadfb0a3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:50.864095 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-419d08eb-9fc0-4210-aad0-10d3aadfb0a3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:50.864544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-419d08eb-9fc0-4210-aad0-10d3aadfb0a3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:50.865311 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-419d08eb-9fc0-4210-aad0-10d3aadfb0a3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:50.865749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-419d08eb-9fc0-4210-aad0-10d3aadfb0a3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:50.914267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2aece9dc-bdc5-4540-91ff-52022724e3ec tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:50.914872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2aece9dc-bdc5-4540-91ff-52022724e3ec tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:50.921286 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2aece9dc-bdc5-4540-91ff-52022724e3ec tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:50.921852 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2aece9dc-bdc5-4540-91ff-52022724e3ec tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:50.922658 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2aece9dc-bdc5-4540-91ff-52022724e3ec tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:50.923092 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2aece9dc-bdc5-4540-91ff-52022724e3ec tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:51.003200 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-419d08eb-9fc0-4210-aad0-10d3aadfb0a3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:51.010976 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-419d08eb-9fc0-4210-aad0-10d3aadfb0a3 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.158446 Jun 03 15:31:51.014598 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 334/656] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:50 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:51.059691 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2aece9dc-bdc5-4540-91ff-52022724e3ec tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:51.067387 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2aece9dc-bdc5-4540-91ff-52022724e3ec tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1672 microversion: 2.1 time: 0.157063 Jun 03 15:31:51.067950 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 323/657] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:50 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:31:51.448356 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-decbb3f7-d0a7-4534-8989-2d87f079f77c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:51.448965 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-decbb3f7-d0a7-4534-8989-2d87f079f77c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:51.455980 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-decbb3f7-d0a7-4534-8989-2d87f079f77c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:51.456432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-decbb3f7-d0a7-4534-8989-2d87f079f77c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:51.457192 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-decbb3f7-d0a7-4534-8989-2d87f079f77c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:51.457659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-decbb3f7-d0a7-4534-8989-2d87f079f77c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:51.621210 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-decbb3f7-d0a7-4534-8989-2d87f079f77c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:51.629681 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-decbb3f7-d0a7-4534-8989-2d87f079f77c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 200 len: 1614 microversion: 2.1 time: 0.185151 Jun 03 15:31:51.630256 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 335/658] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:51 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 1614 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:52.029662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5dbe55f3-19a9-4c6f-a08d-5e713ce0cc6c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:52.030613 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5dbe55f3-19a9-4c6f-a08d-5e713ce0cc6c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:52.037548 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5dbe55f3-19a9-4c6f-a08d-5e713ce0cc6c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:52.037992 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5dbe55f3-19a9-4c6f-a08d-5e713ce0cc6c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:52.038943 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5dbe55f3-19a9-4c6f-a08d-5e713ce0cc6c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:52.039567 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5dbe55f3-19a9-4c6f-a08d-5e713ce0cc6c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:52.086970 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e82256cb-6e5a-46ee-9d9b-701ebf0a22ed tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:52.087749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e82256cb-6e5a-46ee-9d9b-701ebf0a22ed tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:52.095555 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e82256cb-6e5a-46ee-9d9b-701ebf0a22ed tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:52.096159 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e82256cb-6e5a-46ee-9d9b-701ebf0a22ed tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:52.097647 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e82256cb-6e5a-46ee-9d9b-701ebf0a22ed tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:52.098494 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e82256cb-6e5a-46ee-9d9b-701ebf0a22ed tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:52.244522 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e82256cb-6e5a-46ee-9d9b-701ebf0a22ed tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:52.253351 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e82256cb-6e5a-46ee-9d9b-701ebf0a22ed tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1672 microversion: 2.1 time: 0.172123 Jun 03 15:31:52.254116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 336/659] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:52 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:52.328878 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5dbe55f3-19a9-4c6f-a08d-5e713ce0cc6c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:52.336703 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5dbe55f3-19a9-4c6f-a08d-5e713ce0cc6c tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.311450 Jun 03 15:31:52.337274 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 324/660] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:52 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:52.647168 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f8466b03-5140-437b-9b6a-70cc07169cc6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:52.647912 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f8466b03-5140-437b-9b6a-70cc07169cc6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:52.654639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8466b03-5140-437b-9b6a-70cc07169cc6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:52.655209 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8466b03-5140-437b-9b6a-70cc07169cc6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:52.656624 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8466b03-5140-437b-9b6a-70cc07169cc6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:52.657131 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f8466b03-5140-437b-9b6a-70cc07169cc6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:52.671597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-f8466b03-5140-437b-9b6a-70cc07169cc6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f8466b03-5140-437b-9b6a-70cc07169cc6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa HTTP/1.1 Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:31:52.673884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:31:52.675299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'd49a8a8d-d24d-42e9-8a4d-775920a378aa'} Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:31:52.676071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:31:52.677589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:52.679100 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f8466b03-5140-437b-9b6a-70cc07169cc6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:31:52.679100 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f8466b03-5140-437b-9b6a-70cc07169cc6 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 404 len: 111 microversion: 2.1 time: 0.032376 Jun 03 15:31:52.679100 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 337/661] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:52 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:31:52.685797 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2a8cb0e3-69c3-4a03-b75f-527599ba2d93 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '.version_select at 0x7f92f0ce4af0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:52.704554 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2a8cb0e3-69c3-4a03-b75f-527599ba2d93 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-83876481" status: 202 len: 0 microversion: 2.1 time: 0.022405 Jun 03 15:31:52.705147 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 325/662] 10.222.0.93 () {58 vars in 1214 bytes} [Fri Jun 3 15:31:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-83876481 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:31:53.273217 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9066afa2-8259-469f-b865-d4fd8fffefe9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:53.274272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9066afa2-8259-469f-b865-d4fd8fffefe9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:53.277206 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:53.285469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9066afa2-8259-469f-b865-d4fd8fffefe9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:53.286045 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9066afa2-8259-469f-b865-d4fd8fffefe9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:53.287152 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9066afa2-8259-469f-b865-d4fd8fffefe9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:53.287739 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9066afa2-8259-469f-b865-d4fd8fffefe9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:53.353881 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c6a90dac-21ad-4250-99af-b76fa467bde9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:53.355251 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c6a90dac-21ad-4250-99af-b76fa467bde9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:53.362621 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6a90dac-21ad-4250-99af-b76fa467bde9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:53.363671 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6a90dac-21ad-4250-99af-b76fa467bde9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:53.364816 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6a90dac-21ad-4250-99af-b76fa467bde9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:53.365434 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6a90dac-21ad-4250-99af-b76fa467bde9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:53.444671 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9066afa2-8259-469f-b865-d4fd8fffefe9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:53.454716 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9066afa2-8259-469f-b865-d4fd8fffefe9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1672 microversion: 2.1 time: 0.186337 Jun 03 15:31:53.455293 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 338/663] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:53 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:53.462371 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-50dc12ef-ba69-4452-b154-025b5fa3f825 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: .version_select at 0x7f92f0ba6310>, body: {"keypair": {"name": "tempest-keypair-2016400701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDib2bU5xibuHfFqQ4JWSqzH1EHzszMc9ah6f3lhinr8e14jmiaiJTXKfD5l1Uv0z5gMzwGFm3EowJF6VTsuELg/Z6MRBAEWpsBIMdbEHiHEravxOKDGHUiP+Qzux0DLLw=="}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:53.475435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-50dc12ef-ba69-4452-b154-025b5fa3f825 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:31:53.479393 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-50dc12ef-ba69-4452-b154-025b5fa3f825 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for user 193a35a91a47410f8b12cb2e84b33e1f and project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:31:53.501639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-50dc12ef-ba69-4452-b154-025b5fa3f825 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045035 Jun 03 15:31:53.502243 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 339/664] 10.222.0.93 () {60 vars in 1158 bytes} [Fri Jun 3 15:31:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:53.695828 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c6a90dac-21ad-4250-99af-b76fa467bde9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:53.704000 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c6a90dac-21ad-4250-99af-b76fa467bde9 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.354341 Jun 03 15:31:53.704792 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 326/665] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:53 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:31:53.845898 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-78a5a15b-9724-4704-b85a-b4a8310e9ae5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:53.846337 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-78a5a15b-9724-4704-b85a-b4a8310e9ae5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:53.852805 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-78a5a15b-9724-4704-b85a-b4a8310e9ae5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:53.853273 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-78a5a15b-9724-4704-b85a-b4a8310e9ae5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:53.854090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-78a5a15b-9724-4704-b85a-b4a8310e9ae5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:53.854564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-78a5a15b-9724-4704-b85a-b4a8310e9ae5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:53.958910 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-78a5a15b-9724-4704-b85a-b4a8310e9ae5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lazy-loading 'services' on Instance uuid 99322d93-058a-4216-a672-e7f482aab8d8 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:31:54.069926 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-78a5a15b-9724-4704-b85a-b4a8310e9ae5 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "DELETE /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments/211032b0-631a-4e1e-a276-f74b9c5559f4" status: 202 len: 0 microversion: 2.1 time: 0.224133 Jun 03 15:31:54.070760 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 340/666] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:31:53 2022] DELETE /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments/211032b0-631a-4e1e-a276-f74b9c5559f4 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:31:54.087164 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-63a48b4e-0b1c-466f-939c-aad5b8c19814 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:54.090589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-63a48b4e-0b1c-466f-939c-aad5b8c19814 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:54.099254 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63a48b4e-0b1c-466f-939c-aad5b8c19814 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:54.100139 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63a48b4e-0b1c-466f-939c-aad5b8c19814 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:54.101114 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63a48b4e-0b1c-466f-939c-aad5b8c19814 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:54.101894 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63a48b4e-0b1c-466f-939c-aad5b8c19814 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:54.152863 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:54.160183 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-63a48b4e-0b1c-466f-939c-aad5b8c19814 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080921 Jun 03 15:31:54.164356 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 341/667] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:54 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:54.175583 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-0ffe0e78-f0bf-4c3d-b1ef-256ff3c05b4d req-3c517d45-9bab-4349-b8fb-70e8f6690f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce808322-3f17-4d8f-8d33-909ecba99d7a", "name": "network-vif-deleted", "tag": "4191cebd-3cce-492d-9aee-68a1dfd6dc5f"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:54.179556 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:54.188846 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-0ffe0e78-f0bf-4c3d-b1ef-256ff3c05b4d req-3c517d45-9bab-4349-b8fb-70e8f6690f0d service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:54.189370 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-0ffe0e78-f0bf-4c3d-b1ef-256ff3c05b4d req-3c517d45-9bab-4349-b8fb-70e8f6690f0d service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:54.204618 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-0ffe0e78-f0bf-4c3d-b1ef-256ff3c05b4d req-3c517d45-9bab-4349-b8fb-70e8f6690f0d service nova] Creating event network-vif-deleted:4191cebd-3cce-492d-9aee-68a1dfd6dc5f for instance ce808322-3f17-4d8f-8d33-909ecba99d7a on hv-cinder-83124 Jun 03 15:31:54.211293 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-0ffe0e78-f0bf-4c3d-b1ef-256ff3c05b4d req-3c517d45-9bab-4349-b8fb-70e8f6690f0d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150968 Jun 03 15:31:54.212307 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 327/668] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:31:54.474059 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6332295f-af80-49e4-9f31-d27a74cbdc94 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:54.475558 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6332295f-af80-49e4-9f31-d27a74cbdc94 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:54.484556 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6332295f-af80-49e4-9f31-d27a74cbdc94 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:54.485387 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6332295f-af80-49e4-9f31-d27a74cbdc94 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:54.486282 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6332295f-af80-49e4-9f31-d27a74cbdc94 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:54.486988 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6332295f-af80-49e4-9f31-d27a74cbdc94 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:54.557526 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6332295f-af80-49e4-9f31-d27a74cbdc94 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:54.566738 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6332295f-af80-49e4-9f31-d27a74cbdc94 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1604 microversion: 2.1 time: 0.098341 Jun 03 15:31:54.567557 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 342/669] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:54 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:54.721919 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7aa2bf6a-8fc4-467c-aa20-27386787c300 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:54.722637 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7aa2bf6a-8fc4-467c-aa20-27386787c300 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:54.729960 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7aa2bf6a-8fc4-467c-aa20-27386787c300 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:54.730671 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7aa2bf6a-8fc4-467c-aa20-27386787c300 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:54.731457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7aa2bf6a-8fc4-467c-aa20-27386787c300 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:54.732252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7aa2bf6a-8fc4-467c-aa20-27386787c300 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:54.970681 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7aa2bf6a-8fc4-467c-aa20-27386787c300 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:54.979026 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7aa2bf6a-8fc4-467c-aa20-27386787c300 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.261788 Jun 03 15:31:54.979613 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 328/670] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:54 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:55.172773 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1191444e-fdca-4814-bdab-86d3b5b13084 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:55.173729 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1191444e-fdca-4814-bdab-86d3b5b13084 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:55.187672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1191444e-fdca-4814-bdab-86d3b5b13084 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:55.196780 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1191444e-fdca-4814-bdab-86d3b5b13084 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:55.197704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1191444e-fdca-4814-bdab-86d3b5b13084 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:55.198167 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1191444e-fdca-4814-bdab-86d3b5b13084 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:55.248701 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1191444e-fdca-4814-bdab-86d3b5b13084 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080290 Jun 03 15:31:55.249895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 343/671] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:55 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:55.406970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1480229918", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68719859-5880-402e-b442-370597e1ce2f"}], "security_groups": [{"name": "tempest-securitygroup--2029548758"}], "key_name": "tempest-keypair-2016400701", "user_data": "}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:55.509104 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] validate_networks() for [('68719859-5880-402e-b442-370597e1ce2f', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:31:55.585392 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:55.585925 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:55.592600 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:55.593762 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:55.594518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:55.594982 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:55.629651 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:55.630093 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:55.630558 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lazy-loading 'fault' on Instance uuid ce808322-3f17-4d8f-8d33-909ecba99d7a {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:31:55.701422 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:55.710502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c9249536-4510-425f-b5e4-d3517c5cd493 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 200 len: 1326 microversion: 2.1 time: 0.129160 Jun 03 15:31:55.711418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 344/672] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:55 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 1326 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:55.743335 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-b6a377f2-2183-4209-adf5-d4f99b9c7a2d req-9b88c6a0-ea83-4929-8f52-037bcb8a363d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800d0eab-3550-4b55-8837-765681285f77", "name": "network-vif-unplugged", "status": "completed", "tag": "5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:55.754700 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-b6a377f2-2183-4209-adf5-d4f99b9c7a2d req-9b88c6a0-ea83-4929-8f52-037bcb8a363d service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:55.756273 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-b6a377f2-2183-4209-adf5-d4f99b9c7a2d req-9b88c6a0-ea83-4929-8f52-037bcb8a363d service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:55.768327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-b6a377f2-2183-4209-adf5-d4f99b9c7a2d req-9b88c6a0-ea83-4929-8f52-037bcb8a363d service nova] Creating event network-vif-unplugged:5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533 for instance 800d0eab-3550-4b55-8837-765681285f77 on hv-cinder-83124 Jun 03 15:31:55.773325 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-b6a377f2-2183-4209-adf5-d4f99b9c7a2d req-9b88c6a0-ea83-4929-8f52-037bcb8a363d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033846 Jun 03 15:31:55.774337 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 345/673] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:31:55.945014 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:31:55.945475 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:31:55.945897 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:31:55.946303 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:31:55.946768 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:31:55.956102 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:55.956547 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:55.957433 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:55.957870 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:56.003147 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3a6ddc23-a855-4ccd-8e4a-24212eaa90fa tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:56.004152 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3a6ddc23-a855-4ccd-8e4a-24212eaa90fa tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:56.012230 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3a6ddc23-a855-4ccd-8e4a-24212eaa90fa tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:56.013074 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3a6ddc23-a855-4ccd-8e4a-24212eaa90fa tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:56.014354 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3a6ddc23-a855-4ccd-8e4a-24212eaa90fa tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:56.015075 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3a6ddc23-a855-4ccd-8e4a-24212eaa90fa tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:56.153183 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:31:56.167481 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Getting quotas for user 193a35a91a47410f8b12cb2e84b33e1f and project 3e8f48e1939245eaa67bcd6a27bc7cda. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:31:56.190940 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:31:56.193248 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:31:56.203239 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3a6ddc23-a855-4ccd-8e4a-24212eaa90fa tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:56.213792 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3a6ddc23-a855-4ccd-8e4a-24212eaa90fa tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.220950 Jun 03 15:31:56.214752 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 346/674] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:55 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:56.251799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ba7800f5-0958-4bf9-82db-15fff31bbd48 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.850601 Jun 03 15:31:56.252938 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 329/675] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:31:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:31:56.263426 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0cd61c27-8230-42f7-967b-cd1cec79107b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:56.264634 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0cd61c27-8230-42f7-967b-cd1cec79107b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:56.270004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a10f20fd-8099-424e-ad69-4144715fa05e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:56.271376 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a10f20fd-8099-424e-ad69-4144715fa05e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:56.288762 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a10f20fd-8099-424e-ad69-4144715fa05e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:56.289537 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a10f20fd-8099-424e-ad69-4144715fa05e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:56.290967 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a10f20fd-8099-424e-ad69-4144715fa05e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:56.291683 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a10f20fd-8099-424e-ad69-4144715fa05e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:56.326864 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a10f20fd-8099-424e-ad69-4144715fa05e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061815 Jun 03 15:31:56.327939 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 330/676] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:56 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:56.333656 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0cd61c27-8230-42f7-967b-cd1cec79107b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:56.340890 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0cd61c27-8230-42f7-967b-cd1cec79107b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1242 microversion: 2.1 time: 0.081751 Jun 03 15:31:56.341471 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 347/677] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:56 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:56.673874 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-526969695", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1350769796", "security_groups": [{"name": "tempest-secgroup-smoke-168875648"}], "block_device_mapping_v2": [{"uuid": "c80b0947-d1ad-4b76-97a4-af42d22ebba3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2d580292-795d-4fee-87ce-011961d3c846"}]}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:56.728220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-897c3e98-2fa7-489b-89e1-71d0ece8cb89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:56.729599 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-897c3e98-2fa7-489b-89e1-71d0ece8cb89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:56.736674 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-897c3e98-2fa7-489b-89e1-71d0ece8cb89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:56.737802 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-897c3e98-2fa7-489b-89e1-71d0ece8cb89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:56.739486 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-897c3e98-2fa7-489b-89e1-71d0ece8cb89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:56.740136 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-897c3e98-2fa7-489b-89e1-71d0ece8cb89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:56.756251 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-897c3e98-2fa7-489b-89e1-71d0ece8cb89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] HTTP exception thrown: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-897c3e98-2fa7-489b-89e1-71d0ece8cb89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Request method failure captured: Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a HTTP/1.1 Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigy7rscMn4y1XOHOhOvCQLHFWF0UXIF2lSAAfohzLjEIY555HPP7BX0d9ZwVr19qXVeIm8cJbmWVOFyTIEuz_UX_St09oBUYlXVUrvZnSFjfecCJMriKsFf3bGaqbX6lDAjiETK2pKHYUSqxUsg-B8N2EOJ79aLtqWf6ViU8f01nb8 Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:31:56.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_16edd3f309d54728882acc6d23f8861e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/16edd3f309d54728882acc6d23f8861e"}]}] Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 8632496bdc1b4d06a74caf483c8b0a42 Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:31:56.759783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'ce808322-3f17-4d8f-8d33-909ecba99d7a'} Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:31:56.760673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:31:56.762063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:31:56.766120 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-897c3e98-2fa7-489b-89e1-71d0ece8cb89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Returning 404 to user: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:31:56.767304 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-897c3e98-2fa7-489b-89e1-71d0ece8cb89 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 404 len: 111 microversion: 2.1 time: 0.042950 Jun 03 15:31:56.768087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 348/678] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:56 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:31:56.780333 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2bfc4864-dab5-4295-ba1c-e535265eaf11 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '.version_select at 0x7f92f0bccd30>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:56.802857 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2bfc4864-dab5-4295-ba1c-e535265eaf11 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959807678" status: 202 len: 0 microversion: 2.1 time: 0.026949 Jun 03 15:31:56.807159 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 349/679] 10.222.0.93 () {58 vars in 1217 bytes} [Fri Jun 3 15:31:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959807678 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:31:56.820319 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] validate_networks() for [('2d580292-795d-4fee-87ce-011961d3c846', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:31:57.241811 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3c05ff84-c603-464b-9247-42ede70f0b71 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:57.242749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3c05ff84-c603-464b-9247-42ede70f0b71 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:57.259821 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3c05ff84-c603-464b-9247-42ede70f0b71 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.260275 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3c05ff84-c603-464b-9247-42ede70f0b71 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.261061 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3c05ff84-c603-464b-9247-42ede70f0b71 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.261502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3c05ff84-c603-464b-9247-42ede70f0b71 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.350344 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:31:57.350970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:31:57.351422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:31:57.351911 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:31:57.352397 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:31:57.364351 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.365133 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.366324 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.367123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.387929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Getting quotas for project 141bd2be69f243aa926f28b96eb6f0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:31:57.394726 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Getting quotas for user 7d53405e3f88439f81b67106ad98adc2 and project 141bd2be69f243aa926f28b96eb6f0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:31:57.423342 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3c05ff84-c603-464b-9247-42ede70f0b71 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:57.436212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3c05ff84-c603-464b-9247-42ede70f0b71 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1510 microversion: 2.1 time: 0.200322 Jun 03 15:31:57.450084 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 350/680] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:57 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:57.457058 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-20ac95fc-17d6-4c96-be2f-ef88f193887e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:57.458245 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-20ac95fc-17d6-4c96-be2f-ef88f193887e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:57.465178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20ac95fc-17d6-4c96-be2f-ef88f193887e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.465753 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20ac95fc-17d6-4c96-be2f-ef88f193887e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.466870 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20ac95fc-17d6-4c96-be2f-ef88f193887e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.467470 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20ac95fc-17d6-4c96-be2f-ef88f193887e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.481196 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:31:57.484373 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c80b0947-d1ad-4b76-97a4-af42d22ebba3',volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:31:57.506933 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-20ac95fc-17d6-4c96-be2f-ef88f193887e tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055282 Jun 03 15:31:57.507604 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 351/681] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:31:57 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 15:31:57.521989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6f148b1c-83b9-43a8-bd8c-52fcf46e38fa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:57.522687 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6f148b1c-83b9-43a8-bd8c-52fcf46e38fa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:57.529413 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6f148b1c-83b9-43a8-bd8c-52fcf46e38fa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.529884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6f148b1c-83b9-43a8-bd8c-52fcf46e38fa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.531280 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6f148b1c-83b9-43a8-bd8c-52fcf46e38fa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.531762 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6f148b1c-83b9-43a8-bd8c-52fcf46e38fa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.612748 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6f148b1c-83b9-43a8-bd8c-52fcf46e38fa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:57.621049 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6f148b1c-83b9-43a8-bd8c-52fcf46e38fa tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1294 microversion: 2.1 time: 0.111997 Jun 03 15:31:57.621637 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 352/682] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:57 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:57.626813 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-fd4d798f-2157-4fba-8ba0-9b55b6a26301 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:57.627404 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-fd4d798f-2157-4fba-8ba0-9b55b6a26301 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:57.633993 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fd4d798f-2157-4fba-8ba0-9b55b6a26301 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.634517 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fd4d798f-2157-4fba-8ba0-9b55b6a26301 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.635296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fd4d798f-2157-4fba-8ba0-9b55b6a26301 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.635747 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fd4d798f-2157-4fba-8ba0-9b55b6a26301 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.681408 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5153a399-bbca-4a63-927b-dedf65f6ffca tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.013533 Jun 03 15:31:57.687788 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 331/683] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:31:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:31:57.693775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b4f951fa-64a0-4525-9680-c30d7b0e7f00 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:57.695147 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b4f951fa-64a0-4525-9680-c30d7b0e7f00 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:57.708622 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b4f951fa-64a0-4525-9680-c30d7b0e7f00 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.709167 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b4f951fa-64a0-4525-9680-c30d7b0e7f00 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.710632 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b4f951fa-64a0-4525-9680-c30d7b0e7f00 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.711254 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b4f951fa-64a0-4525-9680-c30d7b0e7f00 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.747545 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b4f951fa-64a0-4525-9680-c30d7b0e7f00 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:31:57.750067 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-fd4d798f-2157-4fba-8ba0-9b55b6a26301 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "POST /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77/action" status: 202 len: 0 microversion: 2.1 time: 0.127158 Jun 03 15:31:57.751066 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 353/684] 10.222.0.93 () {60 vars in 1277 bytes} [Fri Jun 3 15:31:57 2022] POST /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:31:57.756653 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8738f3bc-456e-45eb-94ee-09ef18490c1c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:57.757325 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8738f3bc-456e-45eb-94ee-09ef18490c1c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:57.862497 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8738f3bc-456e-45eb-94ee-09ef18490c1c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:57.876345 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8738f3bc-456e-45eb-94ee-09ef18490c1c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1094 microversion: 2.1 time: 0.123911 Jun 03 15:31:57.877758 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 354/685] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:57 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:57.883111 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b5226f91-53fa-48b6-88a9-99996f31ac63 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:57.883934 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b5226f91-53fa-48b6-88a9-99996f31ac63 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:57.896631 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b5226f91-53fa-48b6-88a9-99996f31ac63 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.897485 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b5226f91-53fa-48b6-88a9-99996f31ac63 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.898681 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b5226f91-53fa-48b6-88a9-99996f31ac63 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:57.899343 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b5226f91-53fa-48b6-88a9-99996f31ac63 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:57.980634 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b4f951fa-64a0-4525-9680-c30d7b0e7f00 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "DELETE /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 204 len: 0 microversion: 2.1 time: 0.290289 Jun 03 15:31:57.986556 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 332/686] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:31:57 2022] DELETE /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:31:57.995799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ac92cd9b-8c5e-46f6-b4c5-2da778175f10 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:57.997506 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ac92cd9b-8c5e-46f6-b4c5-2da778175f10 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:58.003999 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ac92cd9b-8c5e-46f6-b4c5-2da778175f10 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:58.004687 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ac92cd9b-8c5e-46f6-b4c5-2da778175f10 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:58.005575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ac92cd9b-8c5e-46f6-b4c5-2da778175f10 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:58.006120 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ac92cd9b-8c5e-46f6-b4c5-2da778175f10 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:58.010938 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:31:58.170593 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b5226f91-53fa-48b6-88a9-99996f31ac63 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:58.188577 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b5226f91-53fa-48b6-88a9-99996f31ac63 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1518 microversion: 2.1 time: 0.309544 Jun 03 15:31:58.192190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 355/687] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:57 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1518 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:58.201132 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6a127134-0c45-408d-ac87-1eea29932750 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'create', calling method: .version_select at 0x7f92f0ca35e0>, body: {"keypair": {"name": "tempest-keypair-1777162757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXByyhhTLJU5uJYAZlj385Cwo/76/dDDRd/NPPZuHnNcsXpW9XbSRA6tItYMpQX0zwjE3MH2d94QFDUzkUJQIYzFK9mVeWBd2SbdJ4572YsJBDCs4NshtelnxidXRDVQQ=="}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:31:58.227690 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-6a127134-0c45-408d-ac87-1eea29932750 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Getting quotas for project 16edd3f309d54728882acc6d23f8861e. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:31:58.234654 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-6a127134-0c45-408d-ac87-1eea29932750 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Getting quotas for user 8632496bdc1b4d06a74caf483c8b0a42 and project 16edd3f309d54728882acc6d23f8861e. Resources: {'key_pairs'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:31:58.262961 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ac92cd9b-8c5e-46f6-b4c5-2da778175f10 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:58.270144 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6a127134-0c45-408d-ac87-1eea29932750 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076695 Jun 03 15:31:58.271088 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 356/688] 10.222.0.93 () {60 vars in 1158 bytes} [Fri Jun 3 15:31:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:31:58.273045 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ac92cd9b-8c5e-46f6-b4c5-2da778175f10 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1690 microversion: 2.1 time: 0.281327 Jun 03 15:31:58.273769 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 333/689] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:57 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1690 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:58.638746 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3b2ba791-462c-4f3a-a9e1-c6c022291284 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:58.639625 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3b2ba791-462c-4f3a-a9e1-c6c022291284 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:58.647421 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3b2ba791-462c-4f3a-a9e1-c6c022291284 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:58.647879 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3b2ba791-462c-4f3a-a9e1-c6c022291284 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:58.648691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3b2ba791-462c-4f3a-a9e1-c6c022291284 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:58.649135 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3b2ba791-462c-4f3a-a9e1-c6c022291284 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:58.726914 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3b2ba791-462c-4f3a-a9e1-c6c022291284 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:58.735848 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3b2ba791-462c-4f3a-a9e1-c6c022291284 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1312 microversion: 2.1 time: 0.101188 Jun 03 15:31:58.736721 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 357/690] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:58 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:58.894960 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c135c8e9-eb98-4870-9a52-27a9e9409c9b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:58.895567 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c135c8e9-eb98-4870-9a52-27a9e9409c9b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:58.902083 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c135c8e9-eb98-4870-9a52-27a9e9409c9b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:58.902552 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c135c8e9-eb98-4870-9a52-27a9e9409c9b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:58.903337 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c135c8e9-eb98-4870-9a52-27a9e9409c9b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:58.903784 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c135c8e9-eb98-4870-9a52-27a9e9409c9b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:58.969984 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c135c8e9-eb98-4870-9a52-27a9e9409c9b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:58.977571 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c135c8e9-eb98-4870-9a52-27a9e9409c9b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1144 microversion: 2.1 time: 0.087400 Jun 03 15:31:58.978148 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 334/691] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:58 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:31:59.208271 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4d3752c9-9e5c-464d-be77-07b5086b9a99 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:59.209020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4d3752c9-9e5c-464d-be77-07b5086b9a99 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:59.217269 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4d3752c9-9e5c-464d-be77-07b5086b9a99 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:59.217624 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4d3752c9-9e5c-464d-be77-07b5086b9a99 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:59.218542 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4d3752c9-9e5c-464d-be77-07b5086b9a99 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:59.219066 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4d3752c9-9e5c-464d-be77-07b5086b9a99 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:59.294092 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-772d4378-3f66-4bec-b22e-dde58eb8e859 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:59.295436 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-772d4378-3f66-4bec-b22e-dde58eb8e859 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:59.303695 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-772d4378-3f66-4bec-b22e-dde58eb8e859 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:59.304577 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-772d4378-3f66-4bec-b22e-dde58eb8e859 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:59.306078 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-772d4378-3f66-4bec-b22e-dde58eb8e859 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:59.306619 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-772d4378-3f66-4bec-b22e-dde58eb8e859 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:59.383009 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4d3752c9-9e5c-464d-be77-07b5086b9a99 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:59.393277 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4d3752c9-9e5c-464d-be77-07b5086b9a99 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1518 microversion: 2.1 time: 0.189255 Jun 03 15:31:59.393890 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 358/692] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:59 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:59.586162 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-772d4378-3f66-4bec-b22e-dde58eb8e859 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:59.595219 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-772d4378-3f66-4bec-b22e-dde58eb8e859 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1690 microversion: 2.1 time: 0.306361 Jun 03 15:31:59.596257 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 335/693] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:59 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1690 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:59.754810 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bca0a5db-5503-44ff-a7de-695017e0035b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:59.755525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-bca0a5db-5503-44ff-a7de-695017e0035b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:31:59.762785 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bca0a5db-5503-44ff-a7de-695017e0035b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:59.763332 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bca0a5db-5503-44ff-a7de-695017e0035b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:59.764486 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bca0a5db-5503-44ff-a7de-695017e0035b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:31:59.765530 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bca0a5db-5503-44ff-a7de-695017e0035b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:31:59.841744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-bca0a5db-5503-44ff-a7de-695017e0035b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:31:59.857585 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-bca0a5db-5503-44ff-a7de-695017e0035b tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1312 microversion: 2.1 time: 0.107794 Jun 03 15:31:59.860176 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 359/694] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:59 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:31:59.996919 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f7d1f344-7dbc-44d5-bc77-c06475479365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:31:59.997634 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f7d1f344-7dbc-44d5-bc77-c06475479365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:00.005033 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f7d1f344-7dbc-44d5-bc77-c06475479365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:00.005407 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f7d1f344-7dbc-44d5-bc77-c06475479365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:00.006172 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f7d1f344-7dbc-44d5-bc77-c06475479365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:00.006727 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f7d1f344-7dbc-44d5-bc77-c06475479365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:00.024989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1060177067", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc85e51d-f7a3-45da-ad6c-8c73a576aa2c"}], "security_groups": [{"name": "tempest-securitygroup--645039280"}], "key_name": "tempest-keypair-1777162757", "user_data": "}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:00.075774 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f7d1f344-7dbc-44d5-bc77-c06475479365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:00.083502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f7d1f344-7dbc-44d5-bc77-c06475479365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1144 microversion: 2.1 time: 0.090398 Jun 03 15:32:00.084204 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 336/695] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:31:59 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:00.127260 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.network.neutron [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] validate_networks() for [('fc85e51d-f7a3-45da-ad6c-8c73a576aa2c', None, None, None, None, None)] {{(pid=117806) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:32:00.411741 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c794d567-750c-4c7d-81c9-f8534f627c1e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:00.412480 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c794d567-750c-4c7d-81c9-f8534f627c1e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:00.419146 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c794d567-750c-4c7d-81c9-f8534f627c1e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:00.419658 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c794d567-750c-4c7d-81c9-f8534f627c1e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:00.420592 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c794d567-750c-4c7d-81c9-f8534f627c1e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:00.421156 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c794d567-750c-4c7d-81c9-f8534f627c1e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:00.527300 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Flavor limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:32:00.527787 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Image limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:32:00.528193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Flavor pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:32:00.528728 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Image pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:32:00.529174 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:32:00.538981 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:00.539433 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:00.540331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:00.540743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:00.558452 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Getting quotas for project 16edd3f309d54728882acc6d23f8861e. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:32:00.564308 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Getting quotas for user 8632496bdc1b4d06a74caf483c8b0a42 and project 16edd3f309d54728882acc6d23f8861e. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:32:00.573451 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c794d567-750c-4c7d-81c9-f8534f627c1e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:00.581757 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Going to run 1 instances... {{(pid=117806) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:32:00.583234 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c794d567-750c-4c7d-81c9-f8534f627c1e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1518 microversion: 2.1 time: 0.175897 Jun 03 15:32:00.583849 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 337/696] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:00 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:00.584097 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:32:00.614196 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0c091fed-c5ca-4093-ae85-b4c8e9c7a182 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:00.615149 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0c091fed-c5ca-4093-ae85-b4c8e9c7a182 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:00.624161 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0c091fed-c5ca-4093-ae85-b4c8e9c7a182 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:00.624640 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0c091fed-c5ca-4093-ae85-b4c8e9c7a182 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:00.625431 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0c091fed-c5ca-4093-ae85-b4c8e9c7a182 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:00.625869 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0c091fed-c5ca-4093-ae85-b4c8e9c7a182 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:00.635163 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9f1e5386-fef6-49b4-af4d-cd8f27f32638 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.614431 Jun 03 15:32:00.635987 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 360/697] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:32:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 15:32:00.646544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5061beb7-a7e7-44db-8da4-b98ea7ca76f4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:00.647175 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5061beb7-a7e7-44db-8da4-b98ea7ca76f4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:00.712872 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5061beb7-a7e7-44db-8da4-b98ea7ca76f4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:00.721285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5061beb7-a7e7-44db-8da4-b98ea7ca76f4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1238 microversion: 2.1 time: 0.078474 Jun 03 15:32:00.722255 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 361/698] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:00 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:00.782655 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0c091fed-c5ca-4093-ae85-b4c8e9c7a182 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:00.790953 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0c091fed-c5ca-4093-ae85-b4c8e9c7a182 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1690 microversion: 2.1 time: 0.181302 Jun 03 15:32:00.791541 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 338/699] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:00 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:00.876539 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-571450a3-91f3-4a33-99c2-1fc6ab67a54c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:00.877156 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-571450a3-91f3-4a33-99c2-1fc6ab67a54c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:00.883338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-571450a3-91f3-4a33-99c2-1fc6ab67a54c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:00.883845 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-571450a3-91f3-4a33-99c2-1fc6ab67a54c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:00.884621 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-571450a3-91f3-4a33-99c2-1fc6ab67a54c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:00.885064 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-571450a3-91f3-4a33-99c2-1fc6ab67a54c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:00.953164 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-571450a3-91f3-4a33-99c2-1fc6ab67a54c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:00.960930 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-571450a3-91f3-4a33-99c2-1fc6ab67a54c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1312 microversion: 2.1 time: 0.088487 Jun 03 15:32:00.961507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 362/700] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:00 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:01.100717 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3b538257-f560-4356-a5c6-eaddd6b73a30 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:01.101262 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3b538257-f560-4356-a5c6-eaddd6b73a30 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:01.108196 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3b538257-f560-4356-a5c6-eaddd6b73a30 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:01.108653 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3b538257-f560-4356-a5c6-eaddd6b73a30 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:01.109423 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3b538257-f560-4356-a5c6-eaddd6b73a30 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:01.109858 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3b538257-f560-4356-a5c6-eaddd6b73a30 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:01.171773 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3b538257-f560-4356-a5c6-eaddd6b73a30 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:01.179355 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3b538257-f560-4356-a5c6-eaddd6b73a30 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1144 microversion: 2.1 time: 0.082682 Jun 03 15:32:01.179912 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 339/701] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:01 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:01.600778 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e8d3813b-4c87-4c34-8c4b-e3a175a1a06e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:01.601511 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e8d3813b-4c87-4c34-8c4b-e3a175a1a06e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:01.608999 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e8d3813b-4c87-4c34-8c4b-e3a175a1a06e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:01.610662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e8d3813b-4c87-4c34-8c4b-e3a175a1a06e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:01.610662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e8d3813b-4c87-4c34-8c4b-e3a175a1a06e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:01.610893 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e8d3813b-4c87-4c34-8c4b-e3a175a1a06e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:01.740008 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2f3bc5f4-4d27-4608-8e3d-d0545affffd3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:01.740986 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2f3bc5f4-4d27-4608-8e3d-d0545affffd3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:01.752277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2f3bc5f4-4d27-4608-8e3d-d0545affffd3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:01.752729 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2f3bc5f4-4d27-4608-8e3d-d0545affffd3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:01.753737 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2f3bc5f4-4d27-4608-8e3d-d0545affffd3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:01.754486 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2f3bc5f4-4d27-4608-8e3d-d0545affffd3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:01.764873 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e8d3813b-4c87-4c34-8c4b-e3a175a1a06e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:01.775306 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e8d3813b-4c87-4c34-8c4b-e3a175a1a06e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1520 microversion: 2.1 time: 0.178727 Jun 03 15:32:01.776897 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 363/702] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:01 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:01.815198 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-96082826-1778-4b69-88e8-144271fe1097 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:01.816244 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-96082826-1778-4b69-88e8-144271fe1097 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:01.822640 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:01.831557 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-96082826-1778-4b69-88e8-144271fe1097 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:01.832354 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-96082826-1778-4b69-88e8-144271fe1097 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:01.833163 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-96082826-1778-4b69-88e8-144271fe1097 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:01.833569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-96082826-1778-4b69-88e8-144271fe1097 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:01.839918 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:01.865274 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2f3bc5f4-4d27-4608-8e3d-d0545affffd3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:01.875178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2f3bc5f4-4d27-4608-8e3d-d0545affffd3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1290 microversion: 2.1 time: 0.138932 Jun 03 15:32:01.875840 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 340/703] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:01 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1290 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:01.978711 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-93fb6df3-51c1-429a-8bc8-fdf0027d7295 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:01.979578 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-93fb6df3-51c1-429a-8bc8-fdf0027d7295 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:01.985812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-96082826-1778-4b69-88e8-144271fe1097 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:01.993225 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-93fb6df3-51c1-429a-8bc8-fdf0027d7295 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:01.993812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-93fb6df3-51c1-429a-8bc8-fdf0027d7295 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:01.994757 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-93fb6df3-51c1-429a-8bc8-fdf0027d7295 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:01.994905 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-96082826-1778-4b69-88e8-144271fe1097 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1690 microversion: 2.1 time: 0.190418 Jun 03 15:32:01.995384 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-93fb6df3-51c1-429a-8bc8-fdf0027d7295 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:01.996187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 364/704] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:01 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:02.197515 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c499a183-94c9-491b-ba33-c2b80bb293d3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:02.198418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c499a183-94c9-491b-ba33-c2b80bb293d3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:02.215108 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c499a183-94c9-491b-ba33-c2b80bb293d3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:02.216418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c499a183-94c9-491b-ba33-c2b80bb293d3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:02.220370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c499a183-94c9-491b-ba33-c2b80bb293d3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:02.221647 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c499a183-94c9-491b-ba33-c2b80bb293d3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:02.303141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c499a183-94c9-491b-ba33-c2b80bb293d3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:02.309728 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-93fb6df3-51c1-429a-8bc8-fdf0027d7295 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:02.314072 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c499a183-94c9-491b-ba33-c2b80bb293d3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1192 microversion: 2.1 time: 0.120921 Jun 03 15:32:02.319352 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 365/705] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:02 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1192 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:02.320475 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-93fb6df3-51c1-429a-8bc8-fdf0027d7295 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.345843 Jun 03 15:32:02.321308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 341/706] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:01 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:02.797004 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b4f64fe9-740f-4289-b161-cecc12844be4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:02.798273 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b4f64fe9-740f-4289-b161-cecc12844be4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:02.812559 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b4f64fe9-740f-4289-b161-cecc12844be4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:02.812559 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b4f64fe9-740f-4289-b161-cecc12844be4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:02.813499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b4f64fe9-740f-4289-b161-cecc12844be4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:02.814040 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b4f64fe9-740f-4289-b161-cecc12844be4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:02.894085 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8ea96f4c-c5b0-4e4a-b680-fb962e91e78a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:02.895088 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8ea96f4c-c5b0-4e4a-b680-fb962e91e78a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:02.902265 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8ea96f4c-c5b0-4e4a-b680-fb962e91e78a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:02.903038 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8ea96f4c-c5b0-4e4a-b680-fb962e91e78a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:02.904325 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8ea96f4c-c5b0-4e4a-b680-fb962e91e78a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:02.907312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8ea96f4c-c5b0-4e4a-b680-fb962e91e78a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:03.062043 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-8ea96f4c-c5b0-4e4a-b680-fb962e91e78a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:03.072895 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8ea96f4c-c5b0-4e4a-b680-fb962e91e78a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1296 microversion: 2.1 time: 0.184003 Jun 03 15:32:03.073467 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 342/707] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:02 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1296 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:03.086721 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6dcce986-a66c-4683-a487-0474d1fe1f60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:03.087482 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6dcce986-a66c-4683-a487-0474d1fe1f60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:03.095908 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6dcce986-a66c-4683-a487-0474d1fe1f60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:03.096355 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6dcce986-a66c-4683-a487-0474d1fe1f60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:03.097132 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6dcce986-a66c-4683-a487-0474d1fe1f60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:03.098430 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6dcce986-a66c-4683-a487-0474d1fe1f60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:03.112483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b4f64fe9-740f-4289-b161-cecc12844be4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:03.127067 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b4f64fe9-740f-4289-b161-cecc12844be4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1520 microversion: 2.1 time: 0.337058 Jun 03 15:32:03.138145 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 366/708] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:02 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:03.331477 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-737ca60c-9dcf-4f55-998f-3032a142a16a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:03.332329 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-737ca60c-9dcf-4f55-998f-3032a142a16a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:03.339934 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-737ca60c-9dcf-4f55-998f-3032a142a16a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:03.340814 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-737ca60c-9dcf-4f55-998f-3032a142a16a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:03.341767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-737ca60c-9dcf-4f55-998f-3032a142a16a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:03.342369 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-737ca60c-9dcf-4f55-998f-3032a142a16a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:03.443986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-737ca60c-9dcf-4f55-998f-3032a142a16a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:03.462276 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-737ca60c-9dcf-4f55-998f-3032a142a16a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1210 microversion: 2.1 time: 0.134251 Jun 03 15:32:03.464801 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 367/709] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:03 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1210 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:03.479360 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-656931b8-46e6-4c7d-96ed-1cedaaee9ebf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:03.480276 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-656931b8-46e6-4c7d-96ed-1cedaaee9ebf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:03.487800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-656931b8-46e6-4c7d-96ed-1cedaaee9ebf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:03.488370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-656931b8-46e6-4c7d-96ed-1cedaaee9ebf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:03.489163 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-656931b8-46e6-4c7d-96ed-1cedaaee9ebf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:03.489669 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-656931b8-46e6-4c7d-96ed-1cedaaee9ebf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:03.518508 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6dcce986-a66c-4683-a487-0474d1fe1f60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:03.528817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6dcce986-a66c-4683-a487-0474d1fe1f60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1690 microversion: 2.1 time: 0.453718 Jun 03 15:32:03.529391 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 343/710] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:03 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1690 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:03.857037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-656931b8-46e6-4c7d-96ed-1cedaaee9ebf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:03.870478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-656931b8-46e6-4c7d-96ed-1cedaaee9ebf tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.403899 Jun 03 15:32:03.878607 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 368/711] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:03 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:04.092328 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-25b9d04a-9c71-4ef9-8421-3febd1419ddb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:04.093174 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-25b9d04a-9c71-4ef9-8421-3febd1419ddb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:04.100319 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-25b9d04a-9c71-4ef9-8421-3febd1419ddb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:04.101110 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-25b9d04a-9c71-4ef9-8421-3febd1419ddb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:04.102159 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-25b9d04a-9c71-4ef9-8421-3febd1419ddb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:04.102789 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-25b9d04a-9c71-4ef9-8421-3febd1419ddb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:04.149109 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c4b7aab7-4e2b-4385-b6d2-1bc555deffc4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:04.152070 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c4b7aab7-4e2b-4385-b6d2-1bc555deffc4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:04.166247 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c4b7aab7-4e2b-4385-b6d2-1bc555deffc4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:04.168859 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c4b7aab7-4e2b-4385-b6d2-1bc555deffc4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:04.170056 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c4b7aab7-4e2b-4385-b6d2-1bc555deffc4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:04.172548 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c4b7aab7-4e2b-4385-b6d2-1bc555deffc4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:04.913766 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-25b9d04a-9c71-4ef9-8421-3febd1419ddb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:04.931105 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-25b9d04a-9c71-4ef9-8421-3febd1419ddb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.844682 Jun 03 15:32:04.931695 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 344/712] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:04 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:04.936903 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-faa090a4-b761-4f43-9306-ec1b825e6790 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:04.937514 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-faa090a4-b761-4f43-9306-ec1b825e6790 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:04.949998 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-faa090a4-b761-4f43-9306-ec1b825e6790 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:04.950460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-faa090a4-b761-4f43-9306-ec1b825e6790 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:04.951553 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-faa090a4-b761-4f43-9306-ec1b825e6790 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:04.952018 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-faa090a4-b761-4f43-9306-ec1b825e6790 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:04.982576 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c4b7aab7-4e2b-4385-b6d2-1bc555deffc4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:04.996559 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c4b7aab7-4e2b-4385-b6d2-1bc555deffc4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1576 microversion: 2.1 time: 0.853754 Jun 03 15:32:04.997683 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 369/713] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:04 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1576 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:05.002745 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-d24b9c81-20bc-4129-ba60-00bd5fff851d req-04042ab6-e157-4ae6-8d15-f96d55ccc480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f911eff-09ff-4dd0-8c61-7798cc9ad53f", "tag": "b04e40b4-2410-4984-b7d1-f08887d6d894"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:05.011345 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-d24b9c81-20bc-4129-ba60-00bd5fff851d req-04042ab6-e157-4ae6-8d15-f96d55ccc480 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:05.012125 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-d24b9c81-20bc-4129-ba60-00bd5fff851d req-04042ab6-e157-4ae6-8d15-f96d55ccc480 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:05.027352 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-d24b9c81-20bc-4129-ba60-00bd5fff851d req-04042ab6-e157-4ae6-8d15-f96d55ccc480 service nova] Creating event network-changed:b04e40b4-2410-4984-b7d1-f08887d6d894 for instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f on hv-cinder-83124 Jun 03 15:32:05.034500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-d24b9c81-20bc-4129-ba60-00bd5fff851d req-04042ab6-e157-4ae6-8d15-f96d55ccc480 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035202 Jun 03 15:32:05.036107 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 370/714] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:05.199056 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b2fa212b-0aa2-4e2a-bbd7-2a722ada3731 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:05.200617 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b2fa212b-0aa2-4e2a-bbd7-2a722ada3731 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:05.210573 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b2fa212b-0aa2-4e2a-bbd7-2a722ada3731 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:05.211417 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b2fa212b-0aa2-4e2a-bbd7-2a722ada3731 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:05.212402 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b2fa212b-0aa2-4e2a-bbd7-2a722ada3731 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:05.213045 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b2fa212b-0aa2-4e2a-bbd7-2a722ada3731 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:05.337474 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b2fa212b-0aa2-4e2a-bbd7-2a722ada3731 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:05.377273 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b2fa212b-0aa2-4e2a-bbd7-2a722ada3731 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 200 len: 1331 microversion: 2.1 time: 0.339065 Jun 03 15:32:05.378827 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 371/715] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:05 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 1331 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:05.384648 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-69cab71d-f7fd-4e5d-9303-90cfd30f47d0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:05.386626 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-69cab71d-f7fd-4e5d-9303-90cfd30f47d0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:05.399912 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-69cab71d-f7fd-4e5d-9303-90cfd30f47d0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:05.402006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-69cab71d-f7fd-4e5d-9303-90cfd30f47d0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:05.415093 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-69cab71d-f7fd-4e5d-9303-90cfd30f47d0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:05.415793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-69cab71d-f7fd-4e5d-9303-90cfd30f47d0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:05.487502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-faa090a4-b761-4f43-9306-ec1b825e6790 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:05.498175 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-faa090a4-b761-4f43-9306-ec1b825e6790 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.565407 Jun 03 15:32:05.509807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 345/716] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:04 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:05.817429 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-69cab71d-f7fd-4e5d-9303-90cfd30f47d0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:05.832515 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-69cab71d-f7fd-4e5d-9303-90cfd30f47d0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.448818 Jun 03 15:32:05.832515 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 372/717] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:05 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:05.949588 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a9404e34-b21e-42a3-88fb-19ff8fe44725 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:05.950310 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a9404e34-b21e-42a3-88fb-19ff8fe44725 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:05.958365 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a9404e34-b21e-42a3-88fb-19ff8fe44725 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:05.959155 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a9404e34-b21e-42a3-88fb-19ff8fe44725 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:05.960023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a9404e34-b21e-42a3-88fb-19ff8fe44725 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:05.960642 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a9404e34-b21e-42a3-88fb-19ff8fe44725 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:06.008887 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-07a137a0-32af-4bf1-a3ff-7e480c747992 req-960e717c-cb3c-4b52-8544-ef8f5c953807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "697213d5-1b86-415b-bba2-8c09be059aae", "tag": "017c3110-af95-4653-ab4b-2de2cf82c63b"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:06.029330 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-07a137a0-32af-4bf1-a3ff-7e480c747992 req-960e717c-cb3c-4b52-8544-ef8f5c953807 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:06.032081 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-07a137a0-32af-4bf1-a3ff-7e480c747992 req-960e717c-cb3c-4b52-8544-ef8f5c953807 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:06.056195 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-07a137a0-32af-4bf1-a3ff-7e480c747992 req-960e717c-cb3c-4b52-8544-ef8f5c953807 service nova] Creating event network-changed:017c3110-af95-4653-ab4b-2de2cf82c63b for instance 697213d5-1b86-415b-bba2-8c09be059aae on hv-cinder-83124 Jun 03 15:32:06.063929 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-07a137a0-32af-4bf1-a3ff-7e480c747992 req-960e717c-cb3c-4b52-8544-ef8f5c953807 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060225 Jun 03 15:32:06.064758 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 373/718] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:06.070290 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8cb35a12-0c5b-4c94-b92d-04c92d2d3a86 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:06.071037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8cb35a12-0c5b-4c94-b92d-04c92d2d3a86 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:06.079097 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8cb35a12-0c5b-4c94-b92d-04c92d2d3a86 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:06.079551 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8cb35a12-0c5b-4c94-b92d-04c92d2d3a86 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:06.080366 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8cb35a12-0c5b-4c94-b92d-04c92d2d3a86 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:06.080798 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8cb35a12-0c5b-4c94-b92d-04c92d2d3a86 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:06.183731 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a9404e34-b21e-42a3-88fb-19ff8fe44725 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:06.193339 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a9404e34-b21e-42a3-88fb-19ff8fe44725 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.248381 Jun 03 15:32:06.193939 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 346/719] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:05 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:06.385255 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8cb35a12-0c5b-4c94-b92d-04c92d2d3a86 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:06.395863 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9749aab5-f83b-49f1-8549-87c3de7ea46b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:06.396516 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9749aab5-f83b-49f1-8549-87c3de7ea46b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 99322d93-058a-4216-a672-e7f482aab8d8] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:06.397801 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8cb35a12-0c5b-4c94-b92d-04c92d2d3a86 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1576 microversion: 2.1 time: 0.332054 Jun 03 15:32:06.398661 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 374/720] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:06 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1576 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:06.408860 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9749aab5-f83b-49f1-8549-87c3de7ea46b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:06.408860 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9749aab5-f83b-49f1-8549-87c3de7ea46b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:06.408860 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9749aab5-f83b-49f1-8549-87c3de7ea46b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:06.408860 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9749aab5-f83b-49f1-8549-87c3de7ea46b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:06.429788 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-9749aab5-f83b-49f1-8549-87c3de7ea46b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] HTTP exception thrown: Instance 99322d93-058a-4216-a672-e7f482aab8d8 could not be found. Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9749aab5-f83b-49f1-8549-87c3de7ea46b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Request method failure captured: Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 HTTP/1.1 Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimihFnnSpT9vHcDE8w6rETruaBiPqie-4gBLlICtuPxNIrX0L7M8mdfgmZlPQf6rvIjW8Fnhg2auvD99GfAJ0MDd3ZgsJRSnPycIpx0d5syjzQnhKJUa-jr3zhJXj3ZKMz4Ll2eHi5iI_vUx_dL-hj77lNzuSckrOXnuBrt6wdhuCS6g Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: a402ec1153624838be07cda58279f2a4 Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:32:06.431861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a402ec1153624838be07cda58279f2a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a402ec1153624838be07cda58279f2a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a402ec1153624838be07cda58279f2a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a402ec1153624838be07cda58279f2a4"}]}] Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: a402ec1153624838be07cda58279f2a4 Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-ServerRescueNegativeTestJSON-2095995501-project Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 127a6938bc5c4416a9a502d9064344cd Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2095995501-project Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 99322d93-058a-4216-a672-e7f482aab8d8 could not be found. Jun 03 15:32:06.433267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '99322d93-058a-4216-a672-e7f482aab8d8'} Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99322d93-058a-4216-a672-e7f482aab8d8 could not be found. Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:32:06.434194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99322d93-058a-4216-a672-e7f482aab8d8 could not be found. Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99322d93-058a-4216-a672-e7f482aab8d8 could not be found. Jun 03 15:32:06.435673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:32:06.438259 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9749aab5-f83b-49f1-8549-87c3de7ea46b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Returning 404 to user: Instance 99322d93-058a-4216-a672-e7f482aab8d8 could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:32:06.438259 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9749aab5-f83b-49f1-8549-87c3de7ea46b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8" status: 404 len: 111 microversion: 2.1 time: 0.042560 Jun 03 15:32:06.438259 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 347/721] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:06 2022] GET /compute/v2.1/servers/99322d93-058a-4216-a672-e7f482aab8d8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:32:06.445955 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2b0c4acd-cfbb-4016-884a-2b236fd270a7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '.version_select at 0x7f92f0cec9d0>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:06.469088 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2b0c4acd-cfbb-4016-884a-2b236fd270a7 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1189744404" status: 202 len: 0 microversion: 2.1 time: 0.026685 Jun 03 15:32:06.469685 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 375/722] 10.222.0.93 () {58 vars in 1220 bytes} [Fri Jun 3 15:32:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1189744404 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:32:06.517782 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-76e73bfb-4675-48bc-82f7-1b943bd7c1c9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:06.518414 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-76e73bfb-4675-48bc-82f7-1b943bd7c1c9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:06.528612 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76e73bfb-4675-48bc-82f7-1b943bd7c1c9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:06.529071 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76e73bfb-4675-48bc-82f7-1b943bd7c1c9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:06.529872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76e73bfb-4675-48bc-82f7-1b943bd7c1c9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:06.533889 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76e73bfb-4675-48bc-82f7-1b943bd7c1c9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:06.784118 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-76e73bfb-4675-48bc-82f7-1b943bd7c1c9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:06.795985 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-76e73bfb-4675-48bc-82f7-1b943bd7c1c9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.282694 Jun 03 15:32:06.807396 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 348/723] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:06 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:06.852403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-92608dcd-814c-493d-b396-4c9e09c1fa24 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:06.853028 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-92608dcd-814c-493d-b396-4c9e09c1fa24 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:06.861268 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-92608dcd-814c-493d-b396-4c9e09c1fa24 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:06.861797 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-92608dcd-814c-493d-b396-4c9e09c1fa24 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:06.862863 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-92608dcd-814c-493d-b396-4c9e09c1fa24 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:06.863530 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-92608dcd-814c-493d-b396-4c9e09c1fa24 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:07.093207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-92608dcd-814c-493d-b396-4c9e09c1fa24 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:07.101779 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-92608dcd-814c-493d-b396-4c9e09c1fa24 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.253175 Jun 03 15:32:07.113439 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 376/724] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:06 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:07.123895 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-7b7fb80f-94ea-4991-b860-c4d6eabdc65e req-6dd4f9e0-8c9b-4b95-ab85-1ded2c229c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99322d93-058a-4216-a672-e7f482aab8d8", "name": "network-vif-deleted", "tag": "3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:07.132507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-7b7fb80f-94ea-4991-b860-c4d6eabdc65e req-6dd4f9e0-8c9b-4b95-ab85-1ded2c229c85 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:07.133039 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-7b7fb80f-94ea-4991-b860-c4d6eabdc65e req-6dd4f9e0-8c9b-4b95-ab85-1ded2c229c85 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:07.145317 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-7b7fb80f-94ea-4991-b860-c4d6eabdc65e req-6dd4f9e0-8c9b-4b95-ab85-1ded2c229c85 service nova] Creating event network-vif-deleted:3b17bbb3-3ed4-4d6c-9a10-b7ae4884c7ee for instance 99322d93-058a-4216-a672-e7f482aab8d8 on hv-cinder-83124 Jun 03 15:32:07.151135 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-7b7fb80f-94ea-4991-b860-c4d6eabdc65e req-6dd4f9e0-8c9b-4b95-ab85-1ded2c229c85 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030911 Jun 03 15:32:07.151801 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 349/725] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:32:07.211489 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-01607ada-0a01-42d5-9b8a-91fad16567da tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:07.212145 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-01607ada-0a01-42d5-9b8a-91fad16567da tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:07.219643 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-01607ada-0a01-42d5-9b8a-91fad16567da tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:07.220197 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-01607ada-0a01-42d5-9b8a-91fad16567da tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:07.221137 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-01607ada-0a01-42d5-9b8a-91fad16567da tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:07.221704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-01607ada-0a01-42d5-9b8a-91fad16567da tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:07.413537 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=4 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:07.414393 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=12 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:07.419408 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-91ad1fe9-97fd-42a9-8a75-b2a5671548fe tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:07.420484 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-91ad1fe9-97fd-42a9-8a75-b2a5671548fe tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:07.427991 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-01607ada-0a01-42d5-9b8a-91fad16567da tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:07.428134 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91ad1fe9-97fd-42a9-8a75-b2a5671548fe tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:07.428555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91ad1fe9-97fd-42a9-8a75-b2a5671548fe tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:07.429562 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91ad1fe9-97fd-42a9-8a75-b2a5671548fe tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:07.430173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-91ad1fe9-97fd-42a9-8a75-b2a5671548fe tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:07.435884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-01607ada-0a01-42d5-9b8a-91fad16567da tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.228913 Jun 03 15:32:07.436463 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 377/726] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:07 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:07.673608 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-91ad1fe9-97fd-42a9-8a75-b2a5671548fe tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:07.683796 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-91ad1fe9-97fd-42a9-8a75-b2a5671548fe tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1576 microversion: 2.1 time: 0.271048 Jun 03 15:32:07.687713 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 350/727] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:07 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:07.813897 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7c8a1fd5-2fcf-4f7a-abad-280c6f80462d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:07.814635 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7c8a1fd5-2fcf-4f7a-abad-280c6f80462d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:07.821121 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c8a1fd5-2fcf-4f7a-abad-280c6f80462d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:07.822430 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c8a1fd5-2fcf-4f7a-abad-280c6f80462d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:07.823524 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c8a1fd5-2fcf-4f7a-abad-280c6f80462d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:07.824591 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c8a1fd5-2fcf-4f7a-abad-280c6f80462d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:08.082274 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-0bf69856-f5a8-4d62-9dc7-0333c936a472 req-6e84a2cc-6054-4bef-b88a-6b25a5435644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b12e6d4-7911-4c08-a28d-aadf2beda784", "tag": "7520f1aa-d4f8-4c3e-9b98-3e91e6261e2c"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:08.088744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7c8a1fd5-2fcf-4f7a-abad-280c6f80462d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:08.091361 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-0bf69856-f5a8-4d62-9dc7-0333c936a472 req-6e84a2cc-6054-4bef-b88a-6b25a5435644 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:08.091882 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-0bf69856-f5a8-4d62-9dc7-0333c936a472 req-6e84a2cc-6054-4bef-b88a-6b25a5435644 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:08.097198 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7c8a1fd5-2fcf-4f7a-abad-280c6f80462d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.287820 Jun 03 15:32:08.097700 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=100 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:08.098469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 378/728] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:07 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:08.105966 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-0bf69856-f5a8-4d62-9dc7-0333c936a472 req-6e84a2cc-6054-4bef-b88a-6b25a5435644 service nova] Creating event network-changed:7520f1aa-d4f8-4c3e-9b98-3e91e6261e2c for instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 on hv-cinder-83124 Jun 03 15:32:08.111832 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-0bf69856-f5a8-4d62-9dc7-0333c936a472 req-6e84a2cc-6054-4bef-b88a-6b25a5435644 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033285 Jun 03 15:32:08.112788 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 351/729] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:32:08.121040 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9e9061e3-fa9c-4e91-8d2f-c074f1280033 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:08.121660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9e9061e3-fa9c-4e91-8d2f-c074f1280033 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:08.128341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e9061e3-fa9c-4e91-8d2f-c074f1280033 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:08.128797 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e9061e3-fa9c-4e91-8d2f-c074f1280033 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:08.129597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e9061e3-fa9c-4e91-8d2f-c074f1280033 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:08.130041 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9e9061e3-fa9c-4e91-8d2f-c074f1280033 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:08.285083 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9e9061e3-fa9c-4e91-8d2f-c074f1280033 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:08.293363 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9e9061e3-fa9c-4e91-8d2f-c074f1280033 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.176365 Jun 03 15:32:08.294473 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 379/730] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:08 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:08.454821 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4eb53e21-fd87-4b28-93db-0fe269b2f8c3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:08.456064 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4eb53e21-fd87-4b28-93db-0fe269b2f8c3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:08.463362 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4eb53e21-fd87-4b28-93db-0fe269b2f8c3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:08.463821 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4eb53e21-fd87-4b28-93db-0fe269b2f8c3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:08.465360 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4eb53e21-fd87-4b28-93db-0fe269b2f8c3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:08.465829 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4eb53e21-fd87-4b28-93db-0fe269b2f8c3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:08.704549 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e92a2f28-0505-4e94-a237-bbf3c5eaf7c6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:08.705342 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e92a2f28-0505-4e94-a237-bbf3c5eaf7c6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:08.711993 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e92a2f28-0505-4e94-a237-bbf3c5eaf7c6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:08.712779 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e92a2f28-0505-4e94-a237-bbf3c5eaf7c6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:08.714297 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e92a2f28-0505-4e94-a237-bbf3c5eaf7c6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:08.715030 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e92a2f28-0505-4e94-a237-bbf3c5eaf7c6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:08.765308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4eb53e21-fd87-4b28-93db-0fe269b2f8c3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:08.773535 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4eb53e21-fd87-4b28-93db-0fe269b2f8c3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.323795 Jun 03 15:32:08.785070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 352/731] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:08 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:08.916604 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e92a2f28-0505-4e94-a237-bbf3c5eaf7c6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:08.925646 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e92a2f28-0505-4e94-a237-bbf3c5eaf7c6 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1576 microversion: 2.1 time: 0.225472 Jun 03 15:32:08.926346 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 380/732] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:08 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1576 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:09.115460 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b54fd734-290a-48cb-8007-17e6ae65bb88 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:09.116042 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b54fd734-290a-48cb-8007-17e6ae65bb88 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:09.122346 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b54fd734-290a-48cb-8007-17e6ae65bb88 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:09.122879 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b54fd734-290a-48cb-8007-17e6ae65bb88 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:09.123667 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b54fd734-290a-48cb-8007-17e6ae65bb88 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:09.124172 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b54fd734-290a-48cb-8007-17e6ae65bb88 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:09.259322 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b54fd734-290a-48cb-8007-17e6ae65bb88 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:09.267863 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b54fd734-290a-48cb-8007-17e6ae65bb88 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.156614 Jun 03 15:32:09.268421 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 353/733] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:09 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:09.311718 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e74272f7-5f70-4e8b-8b55-c0fd30b2ecab tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:09.312370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e74272f7-5f70-4e8b-8b55-c0fd30b2ecab tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:09.318506 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e74272f7-5f70-4e8b-8b55-c0fd30b2ecab tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:09.319006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e74272f7-5f70-4e8b-8b55-c0fd30b2ecab tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:09.319818 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e74272f7-5f70-4e8b-8b55-c0fd30b2ecab tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:09.320276 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e74272f7-5f70-4e8b-8b55-c0fd30b2ecab tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:09.449778 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e74272f7-5f70-4e8b-8b55-c0fd30b2ecab tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:09.458496 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e74272f7-5f70-4e8b-8b55-c0fd30b2ecab tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.151394 Jun 03 15:32:09.459174 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 381/734] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:09 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:09.733787 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-825df45c-3795-4d5d-bb9e-596b69b8ba75 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:09.734285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-825df45c-3795-4d5d-bb9e-596b69b8ba75 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:09.741097 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-825df45c-3795-4d5d-bb9e-596b69b8ba75 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:09.741552 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-825df45c-3795-4d5d-bb9e-596b69b8ba75 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:09.742358 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-825df45c-3795-4d5d-bb9e-596b69b8ba75 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:09.742828 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-825df45c-3795-4d5d-bb9e-596b69b8ba75 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:09.768496 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-825df45c-3795-4d5d-bb9e-596b69b8ba75 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:32:09.792218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9479e8b6-457f-43e6-a8a9-799566da19aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:09.793225 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9479e8b6-457f-43e6-a8a9-799566da19aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:09.800168 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9479e8b6-457f-43e6-a8a9-799566da19aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:09.800619 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9479e8b6-457f-43e6-a8a9-799566da19aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:09.801400 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9479e8b6-457f-43e6-a8a9-799566da19aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:09.801906 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9479e8b6-457f-43e6-a8a9-799566da19aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:09.850241 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-825df45c-3795-4d5d-bb9e-596b69b8ba75 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "DELETE /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 204 len: 0 microversion: 2.1 time: 0.120445 Jun 03 15:32:09.851105 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 354/735] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:32:09 2022] DELETE /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:32:09.860536 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f23eb040-7fab-4a69-b933-5900352e6d60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:09.861245 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f23eb040-7fab-4a69-b933-5900352e6d60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:09.863193 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:09.869116 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f23eb040-7fab-4a69-b933-5900352e6d60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:09.869645 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f23eb040-7fab-4a69-b933-5900352e6d60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:09.870504 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f23eb040-7fab-4a69-b933-5900352e6d60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:09.871092 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f23eb040-7fab-4a69-b933-5900352e6d60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:10.014178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9479e8b6-457f-43e6-a8a9-799566da19aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:10.017843 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f23eb040-7fab-4a69-b933-5900352e6d60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:10.022238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9479e8b6-457f-43e6-a8a9-799566da19aa tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.234188 Jun 03 15:32:10.022828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 382/736] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:09 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:10.025416 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f23eb040-7fab-4a69-b933-5900352e6d60 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1508 microversion: 2.1 time: 0.170020 Jun 03 15:32:10.026131 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 355/737] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:09 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:10.027314 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3f142a03-c0b0-4fd8-93dc-3e5857c6fb7d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:10.027915 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3f142a03-c0b0-4fd8-93dc-3e5857c6fb7d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:10.034927 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3f142a03-c0b0-4fd8-93dc-3e5857c6fb7d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:10.035397 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3f142a03-c0b0-4fd8-93dc-3e5857c6fb7d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:10.036250 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3f142a03-c0b0-4fd8-93dc-3e5857c6fb7d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:10.036712 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3f142a03-c0b0-4fd8-93dc-3e5857c6fb7d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:10.039610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=100 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:10.176855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3f142a03-c0b0-4fd8-93dc-3e5857c6fb7d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:10.184717 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3f142a03-c0b0-4fd8-93dc-3e5857c6fb7d tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1576 microversion: 2.1 time: 0.160828 Jun 03 15:32:10.185223 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 383/738] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:10 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:10.243266 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-6592cce5-5015-4ff9-a32d-39247d0b3822 req-8b58a4f7-c734-44ec-9743-00eb6b470b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800d0eab-3550-4b55-8837-765681285f77", "name": "network-vif-plugged", "status": "completed", "tag": "5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:10.251735 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-6592cce5-5015-4ff9-a32d-39247d0b3822 req-8b58a4f7-c734-44ec-9743-00eb6b470b65 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:10.252266 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-6592cce5-5015-4ff9-a32d-39247d0b3822 req-8b58a4f7-c734-44ec-9743-00eb6b470b65 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:10.263369 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-6592cce5-5015-4ff9-a32d-39247d0b3822 req-8b58a4f7-c734-44ec-9743-00eb6b470b65 service nova] Creating event network-vif-plugged:5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533 for instance 800d0eab-3550-4b55-8837-765681285f77 on hv-cinder-83124 Jun 03 15:32:10.268957 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-6592cce5-5015-4ff9-a32d-39247d0b3822 req-8b58a4f7-c734-44ec-9743-00eb6b470b65 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029298 Jun 03 15:32:10.269549 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 356/739] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:10.285702 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-68b7bdbe-2619-4ad7-99f2-cc32f2762ea8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:10.286429 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-68b7bdbe-2619-4ad7-99f2-cc32f2762ea8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:10.292531 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-68b7bdbe-2619-4ad7-99f2-cc32f2762ea8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:10.293081 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-68b7bdbe-2619-4ad7-99f2-cc32f2762ea8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:10.293930 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-68b7bdbe-2619-4ad7-99f2-cc32f2762ea8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:10.294520 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-68b7bdbe-2619-4ad7-99f2-cc32f2762ea8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:10.433247 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-68b7bdbe-2619-4ad7-99f2-cc32f2762ea8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:10.441237 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-68b7bdbe-2619-4ad7-99f2-cc32f2762ea8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.159616 Jun 03 15:32:10.441838 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 384/740] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:10 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:10.476912 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-363f48f4-1312-4665-b361-af0c8af363c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:10.477616 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-363f48f4-1312-4665-b361-af0c8af363c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:10.484349 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-363f48f4-1312-4665-b361-af0c8af363c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:10.484801 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-363f48f4-1312-4665-b361-af0c8af363c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:10.485578 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-363f48f4-1312-4665-b361-af0c8af363c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:10.486014 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-363f48f4-1312-4665-b361-af0c8af363c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:10.621335 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-363f48f4-1312-4665-b361-af0c8af363c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:10.629242 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-363f48f4-1312-4665-b361-af0c8af363c2 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.156559 Jun 03 15:32:10.629821 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 357/741] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:10 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:11.040371 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-647ad7a8-7450-44be-b65a-d18946213099 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:11.041061 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-647ad7a8-7450-44be-b65a-d18946213099 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:11.043091 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:11.043876 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=20 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:11.044670 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-76942c07-92a6-4391-8792-4c73ca0b6836 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:11.045254 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-76942c07-92a6-4391-8792-4c73ca0b6836 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:11.051855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-647ad7a8-7450-44be-b65a-d18946213099 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:11.052227 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76942c07-92a6-4391-8792-4c73ca0b6836 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:11.052449 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-647ad7a8-7450-44be-b65a-d18946213099 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:11.052679 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76942c07-92a6-4391-8792-4c73ca0b6836 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:11.053284 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-647ad7a8-7450-44be-b65a-d18946213099 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:11.053447 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76942c07-92a6-4391-8792-4c73ca0b6836 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:11.053781 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-647ad7a8-7450-44be-b65a-d18946213099 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:11.053894 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-76942c07-92a6-4391-8792-4c73ca0b6836 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:11.204287 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-76942c07-92a6-4391-8792-4c73ca0b6836 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:11.207062 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-647ad7a8-7450-44be-b65a-d18946213099 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:11.212477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-76942c07-92a6-4391-8792-4c73ca0b6836 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1508 microversion: 2.1 time: 0.172416 Jun 03 15:32:11.213050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 358/742] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:11 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:11.222855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-647ad7a8-7450-44be-b65a-d18946213099 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.179791 Jun 03 15:32:11.222855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 385/743] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:11 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:11.223121 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-be290be1-20d8-4329-81be-cff7aca11501 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:11.223121 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-be290be1-20d8-4329-81be-cff7aca11501 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:11.227456 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-be290be1-20d8-4329-81be-cff7aca11501 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:11.228122 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-be290be1-20d8-4329-81be-cff7aca11501 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:11.228903 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-be290be1-20d8-4329-81be-cff7aca11501 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:11.229335 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-be290be1-20d8-4329-81be-cff7aca11501 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:11.361228 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-be290be1-20d8-4329-81be-cff7aca11501 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:11.368809 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-be290be1-20d8-4329-81be-cff7aca11501 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1576 microversion: 2.1 time: 0.154826 Jun 03 15:32:11.369372 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 359/744] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:11 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:11.459476 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9b0b72c2-c45a-45b7-b81d-382885bb124a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:11.460078 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9b0b72c2-c45a-45b7-b81d-382885bb124a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:11.466171 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9b0b72c2-c45a-45b7-b81d-382885bb124a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:11.466649 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9b0b72c2-c45a-45b7-b81d-382885bb124a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:11.467431 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9b0b72c2-c45a-45b7-b81d-382885bb124a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:11.467945 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9b0b72c2-c45a-45b7-b81d-382885bb124a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:11.599666 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9b0b72c2-c45a-45b7-b81d-382885bb124a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:11.608292 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9b0b72c2-c45a-45b7-b81d-382885bb124a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.152654 Jun 03 15:32:11.608934 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 386/745] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:11 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:11.648593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cbed4547-76c3-4a8e-a619-6e0c9144a578 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:11.649411 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-cbed4547-76c3-4a8e-a619-6e0c9144a578 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:11.655994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cbed4547-76c3-4a8e-a619-6e0c9144a578 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:11.656440 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cbed4547-76c3-4a8e-a619-6e0c9144a578 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:11.657208 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cbed4547-76c3-4a8e-a619-6e0c9144a578 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:11.657640 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cbed4547-76c3-4a8e-a619-6e0c9144a578 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:11.804032 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-cbed4547-76c3-4a8e-a619-6e0c9144a578 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:11.812972 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-cbed4547-76c3-4a8e-a619-6e0c9144a578 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.168588 Jun 03 15:32:11.813598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 360/746] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:11 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:12.230125 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c18715c8-f6b2-4509-aaad-d55c4a3a291b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:12.230767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c18715c8-f6b2-4509-aaad-d55c4a3a291b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:12.234791 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-cc51f235-edf8-4584-a296-05dfc98ae503 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:12.235425 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-cc51f235-edf8-4584-a296-05dfc98ae503 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:12.239041 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c18715c8-f6b2-4509-aaad-d55c4a3a291b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.239450 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c18715c8-f6b2-4509-aaad-d55c4a3a291b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.240519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c18715c8-f6b2-4509-aaad-d55c4a3a291b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.240733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c18715c8-f6b2-4509-aaad-d55c4a3a291b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.242398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc51f235-edf8-4584-a296-05dfc98ae503 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.242923 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc51f235-edf8-4584-a296-05dfc98ae503 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.243713 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc51f235-edf8-4584-a296-05dfc98ae503 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.244156 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-cc51f235-edf8-4584-a296-05dfc98ae503 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.433054 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-cc51f235-edf8-4584-a296-05dfc98ae503 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:12.441563 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-cc51f235-edf8-4584-a296-05dfc98ae503 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.212209 Jun 03 15:32:12.445755 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c18715c8-f6b2-4509-aaad-d55c4a3a291b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:12.451254 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 361/747] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:12 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:12.456792 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-01f210b3-1e8b-4799-9f1a-c32dec887aa3 req-49a58bb9-d13b-4a30-83ef-bc1617e3340e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f911eff-09ff-4dd0-8c61-7798cc9ad53f", "name": "network-vif-plugged", "status": "completed", "tag": "b04e40b4-2410-4984-b7d1-f08887d6d894"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:12.458736 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c18715c8-f6b2-4509-aaad-d55c4a3a291b tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1508 microversion: 2.1 time: 0.232368 Jun 03 15:32:12.471594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 387/748] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:12 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:12.471594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-62118d8a-9c8c-44f3-baac-7e163c43f05f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:12.471594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-62118d8a-9c8c-44f3-baac-7e163c43f05f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:12.475296 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-01f210b3-1e8b-4799-9f1a-c32dec887aa3 req-49a58bb9-d13b-4a30-83ef-bc1617e3340e service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.475851 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-01f210b3-1e8b-4799-9f1a-c32dec887aa3 req-49a58bb9-d13b-4a30-83ef-bc1617e3340e service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.477045 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-62118d8a-9c8c-44f3-baac-7e163c43f05f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.477495 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-62118d8a-9c8c-44f3-baac-7e163c43f05f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.478260 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-62118d8a-9c8c-44f3-baac-7e163c43f05f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.478840 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-62118d8a-9c8c-44f3-baac-7e163c43f05f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.488384 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-01f210b3-1e8b-4799-9f1a-c32dec887aa3 req-49a58bb9-d13b-4a30-83ef-bc1617e3340e service nova] Creating event network-vif-plugged:b04e40b4-2410-4984-b7d1-f08887d6d894 for instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f on hv-cinder-83124 Jun 03 15:32:12.493388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-01f210b3-1e8b-4799-9f1a-c32dec887aa3 req-49a58bb9-d13b-4a30-83ef-bc1617e3340e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040784 Jun 03 15:32:12.494406 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 362/749] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:12.622515 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-62118d8a-9c8c-44f3-baac-7e163c43f05f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:12.627226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-998958d2-6e4e-42e9-b214-760465831927 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:12.628192 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-998958d2-6e4e-42e9-b214-760465831927 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:12.635634 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-998958d2-6e4e-42e9-b214-760465831927 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.636298 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-998958d2-6e4e-42e9-b214-760465831927 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.636718 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-62118d8a-9c8c-44f3-baac-7e163c43f05f tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1576 microversion: 2.1 time: 0.172848 Jun 03 15:32:12.637422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-998958d2-6e4e-42e9-b214-760465831927 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.638122 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-998958d2-6e4e-42e9-b214-760465831927 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.646404 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 388/750] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:12 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:12.829587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-06253040-ccc9-461b-8636-e1dc83a3da15 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:12.830349 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-06253040-ccc9-461b-8636-e1dc83a3da15 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:12.836927 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06253040-ccc9-461b-8636-e1dc83a3da15 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.837151 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06253040-ccc9-461b-8636-e1dc83a3da15 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.838030 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06253040-ccc9-461b-8636-e1dc83a3da15 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:12.838572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06253040-ccc9-461b-8636-e1dc83a3da15 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:12.854900 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-998958d2-6e4e-42e9-b214-760465831927 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:12.863495 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-998958d2-6e4e-42e9-b214-760465831927 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.241495 Jun 03 15:32:12.864672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 363/751] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:12 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:12.989696 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-06253040-ccc9-461b-8636-e1dc83a3da15 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:12.998056 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-06253040-ccc9-461b-8636-e1dc83a3da15 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.172600 Jun 03 15:32:12.999720 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 389/752] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:12 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:13.006398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-236b6d92-a958-4c17-af9c-25140e97d0fb req-185ff6b7-0f1c-457e-8e85-90128cc4ca5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758b095c-6da9-4d53-abba-6a13a7c50904", "name": "network-vif-deleted", "tag": "a6777d99-9001-40c7-8dc0-bac5ca7c5efe"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:13.016320 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-236b6d92-a958-4c17-af9c-25140e97d0fb req-185ff6b7-0f1c-457e-8e85-90128cc4ca5d service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:13.016770 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-236b6d92-a958-4c17-af9c-25140e97d0fb req-185ff6b7-0f1c-457e-8e85-90128cc4ca5d service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:13.027821 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-236b6d92-a958-4c17-af9c-25140e97d0fb req-185ff6b7-0f1c-457e-8e85-90128cc4ca5d service nova] Creating event network-vif-deleted:a6777d99-9001-40c7-8dc0-bac5ca7c5efe for instance 758b095c-6da9-4d53-abba-6a13a7c50904 on hv-cinder-83124 Jun 03 15:32:13.032921 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-236b6d92-a958-4c17-af9c-25140e97d0fb req-185ff6b7-0f1c-457e-8e85-90128cc4ca5d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030566 Jun 03 15:32:13.033492 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 364/753] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:32:13.458622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e880c0f3-6211-48de-a765-c8a21b3707fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:13.459243 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e880c0f3-6211-48de-a765-c8a21b3707fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:13.466008 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e880c0f3-6211-48de-a765-c8a21b3707fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:13.466611 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e880c0f3-6211-48de-a765-c8a21b3707fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:13.467430 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e880c0f3-6211-48de-a765-c8a21b3707fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:13.467876 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e880c0f3-6211-48de-a765-c8a21b3707fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:13.479902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ebd90066-433e-4bcb-96e5-f00bd3616eb1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:13.480595 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ebd90066-433e-4bcb-96e5-f00bd3616eb1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:13.488115 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ebd90066-433e-4bcb-96e5-f00bd3616eb1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:13.488562 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ebd90066-433e-4bcb-96e5-f00bd3616eb1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:13.489330 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ebd90066-433e-4bcb-96e5-f00bd3616eb1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:13.489761 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ebd90066-433e-4bcb-96e5-f00bd3616eb1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:13.554398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ebd90066-433e-4bcb-96e5-f00bd3616eb1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:13.562947 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ebd90066-433e-4bcb-96e5-f00bd3616eb1 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1293 microversion: 2.1 time: 0.086880 Jun 03 15:32:13.563536 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 365/754] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:13 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:13.597282 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e880c0f3-6211-48de-a765-c8a21b3707fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:13.604685 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e880c0f3-6211-48de-a765-c8a21b3707fd tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.150107 Jun 03 15:32:13.605248 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 390/755] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:13 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:13.653907 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e614b510-524c-4d28-839d-5334a87d9155 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:13.654555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e614b510-524c-4d28-839d-5334a87d9155 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:13.661329 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e614b510-524c-4d28-839d-5334a87d9155 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:13.661781 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e614b510-524c-4d28-839d-5334a87d9155 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:13.662555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e614b510-524c-4d28-839d-5334a87d9155 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:13.662996 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e614b510-524c-4d28-839d-5334a87d9155 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:13.802122 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e614b510-524c-4d28-839d-5334a87d9155 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:13.810712 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e614b510-524c-4d28-839d-5334a87d9155 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1576 microversion: 2.1 time: 0.160338 Jun 03 15:32:13.811777 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 366/756] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:13 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:13.880872 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0ef12b95-9572-43a4-8a08-1ed495e142b4 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:13.881478 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0ef12b95-9572-43a4-8a08-1ed495e142b4 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:13.887486 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0ef12b95-9572-43a4-8a08-1ed495e142b4 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:13.888071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0ef12b95-9572-43a4-8a08-1ed495e142b4 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:13.889223 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0ef12b95-9572-43a4-8a08-1ed495e142b4 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:13.889665 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0ef12b95-9572-43a4-8a08-1ed495e142b4 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.016496 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-07ddca59-bc79-4293-abee-9aeef73ec8c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:14.017231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-07ddca59-bc79-4293-abee-9aeef73ec8c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:14.023633 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07ddca59-bc79-4293-abee-9aeef73ec8c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.024177 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07ddca59-bc79-4293-abee-9aeef73ec8c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.025070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07ddca59-bc79-4293-abee-9aeef73ec8c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.025564 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07ddca59-bc79-4293-abee-9aeef73ec8c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.178859 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-07ddca59-bc79-4293-abee-9aeef73ec8c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:14.187993 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-07ddca59-bc79-4293-abee-9aeef73ec8c7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.176215 Jun 03 15:32:14.188763 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 367/757] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:14 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:14.292523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0ef12b95-9572-43a4-8a08-1ed495e142b4 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:14.301062 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0ef12b95-9572-43a4-8a08-1ed495e142b4 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.424118 Jun 03 15:32:14.301963 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 391/758] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:13 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:14.334878 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ed1a1c94-8d63-4487-9578-0a66b8afcd1f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:14.335373 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ed1a1c94-8d63-4487-9578-0a66b8afcd1f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:14.341585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ed1a1c94-8d63-4487-9578-0a66b8afcd1f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.342040 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ed1a1c94-8d63-4487-9578-0a66b8afcd1f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.343572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ed1a1c94-8d63-4487-9578-0a66b8afcd1f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.343992 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ed1a1c94-8d63-4487-9578-0a66b8afcd1f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.370421 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ed1a1c94-8d63-4487-9578-0a66b8afcd1f tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/ips" status: 200 len: 153 microversion: 2.20 time: 0.180353 Jun 03 15:32:14.371005 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 368/759] 10.222.0.93 () {60 vars in 1288 bytes} [Fri Jun 3 15:32:14 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/ips => generated 153 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:32:14.568123 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-5406253b-0366-4f6f-b21a-9d970316127d req-a911c0c8-3e76-43fe-8866-8f9f332413a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697213d5-1b86-415b-bba2-8c09be059aae", "name": "network-vif-plugged", "status": "completed", "tag": "017c3110-af95-4653-ab4b-2de2cf82c63b"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:14.576456 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-5406253b-0366-4f6f-b21a-9d970316127d req-a911c0c8-3e76-43fe-8866-8f9f332413a1 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.576929 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-5406253b-0366-4f6f-b21a-9d970316127d req-a911c0c8-3e76-43fe-8866-8f9f332413a1 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.591957 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-5406253b-0366-4f6f-b21a-9d970316127d req-a911c0c8-3e76-43fe-8866-8f9f332413a1 service nova] Creating event network-vif-plugged:017c3110-af95-4653-ab4b-2de2cf82c63b for instance 697213d5-1b86-415b-bba2-8c09be059aae on hv-cinder-83124 Jun 03 15:32:14.592347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:14.594702 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:14.595096 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-5406253b-0366-4f6f-b21a-9d970316127d req-a911c0c8-3e76-43fe-8866-8f9f332413a1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089615 Jun 03 15:32:14.595743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 392/760] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:14.602339 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.602817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.603592 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.605403 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.608478 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:14.625176 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2fab0b84-f958-478a-8a96-0ae086d52385 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:14.625982 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2fab0b84-f958-478a-8a96-0ae086d52385 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:14.634450 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2fab0b84-f958-478a-8a96-0ae086d52385 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.635082 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2fab0b84-f958-478a-8a96-0ae086d52385 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.635956 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2fab0b84-f958-478a-8a96-0ae086d52385 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.636490 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2fab0b84-f958-478a-8a96-0ae086d52385 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.645325 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.645776 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.646231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lazy-loading 'fault' on Instance uuid 758b095c-6da9-4d53-abba-6a13a7c50904 {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:32:14.698318 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:14.707090 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f07ad3a0-cc73-405f-ad1f-3e1f000454de tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1312 microversion: 2.1 time: 0.128881 Jun 03 15:32:14.707665 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 369/761] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:14 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1312 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:14.782452 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2fab0b84-f958-478a-8a96-0ae086d52385 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:14.789962 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2fab0b84-f958-478a-8a96-0ae086d52385 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.171016 Jun 03 15:32:14.790517 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 393/762] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:14 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:14.827735 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0a7f2a27-2b49-4066-8bbd-ee69cee43384 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:14.828344 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0a7f2a27-2b49-4066-8bbd-ee69cee43384 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:14.834471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0a7f2a27-2b49-4066-8bbd-ee69cee43384 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.834953 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0a7f2a27-2b49-4066-8bbd-ee69cee43384 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.835715 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0a7f2a27-2b49-4066-8bbd-ee69cee43384 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:14.836150 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0a7f2a27-2b49-4066-8bbd-ee69cee43384 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:14.968600 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0a7f2a27-2b49-4066-8bbd-ee69cee43384 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:14.976623 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0a7f2a27-2b49-4066-8bbd-ee69cee43384 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1563 microversion: 2.1 time: 0.152495 Jun 03 15:32:14.977586 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 370/763] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:14 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:15.208327 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1317de79-970c-4ccc-9433-29ef8d0bacfb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:15.208851 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1317de79-970c-4ccc-9433-29ef8d0bacfb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:15.214979 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1317de79-970c-4ccc-9433-29ef8d0bacfb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:15.215428 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1317de79-970c-4ccc-9433-29ef8d0bacfb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:15.216188 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1317de79-970c-4ccc-9433-29ef8d0bacfb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:15.216623 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1317de79-970c-4ccc-9433-29ef8d0bacfb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:15.317661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-31eb7b2a-fc82-4799-ac45-9a4cbc2aab72 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:15.318278 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-31eb7b2a-fc82-4799-ac45-9a4cbc2aab72 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:15.324415 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-31eb7b2a-fc82-4799-ac45-9a4cbc2aab72 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:15.324970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-31eb7b2a-fc82-4799-ac45-9a4cbc2aab72 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:15.325744 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-31eb7b2a-fc82-4799-ac45-9a4cbc2aab72 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:15.326178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-31eb7b2a-fc82-4799-ac45-9a4cbc2aab72 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:15.349943 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1317de79-970c-4ccc-9433-29ef8d0bacfb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:15.357619 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1317de79-970c-4ccc-9433-29ef8d0bacfb tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1368 microversion: 2.1 time: 0.153200 Jun 03 15:32:15.358192 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 394/764] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:15 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:15.458250 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-31eb7b2a-fc82-4799-ac45-9a4cbc2aab72 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:15.465834 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-31eb7b2a-fc82-4799-ac45-9a4cbc2aab72 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.151970 Jun 03 15:32:15.466334 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 371/765] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:15 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:15.725331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:15.725854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:15.733260 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:15.733809 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:15.734597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:15.735033 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:15.766756 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:15.767193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:15.767637 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lazy-loading 'fault' on Instance uuid 758b095c-6da9-4d53-abba-6a13a7c50904 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:32:15.807655 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6172a324-95f3-4f56-97c1-eb08c325422d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:15.808488 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6172a324-95f3-4f56-97c1-eb08c325422d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:15.812158 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:15.816726 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6172a324-95f3-4f56-97c1-eb08c325422d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:15.817390 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6172a324-95f3-4f56-97c1-eb08c325422d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:15.818159 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6172a324-95f3-4f56-97c1-eb08c325422d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:15.818682 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6172a324-95f3-4f56-97c1-eb08c325422d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:15.819603 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-20f737bf-b1b2-4edd-b162-1692a759e449 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 200 len: 1312 microversion: 2.1 time: 0.098256 Jun 03 15:32:15.820169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 395/766] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:15 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:15.963649 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6172a324-95f3-4f56-97c1-eb08c325422d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:15.971831 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6172a324-95f3-4f56-97c1-eb08c325422d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.168271 Jun 03 15:32:15.972397 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 372/767] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:15 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:16.290899 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6370b182-608e-4d96-8397-ec7b474331af tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:16.291440 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6370b182-608e-4d96-8397-ec7b474331af tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:16.298191 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6370b182-608e-4d96-8397-ec7b474331af tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.298665 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6370b182-608e-4d96-8397-ec7b474331af tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.300045 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6370b182-608e-4d96-8397-ec7b474331af tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.300871 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6370b182-608e-4d96-8397-ec7b474331af tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.332001 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-6370b182-608e-4d96-8397-ec7b474331af tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lazy-loading 'flavor' on Instance uuid 43beed7e-5952-4cc8-89ea-8c819ceb44de {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:32:16.375059 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-df4463f1-8e52-4935-a529-ca8a9fb21096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:16.375671 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-df4463f1-8e52-4935-a529-ca8a9fb21096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:16.382042 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df4463f1-8e52-4935-a529-ca8a9fb21096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.382485 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df4463f1-8e52-4935-a529-ca8a9fb21096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.383281 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df4463f1-8e52-4935-a529-ca8a9fb21096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.384501 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-df4463f1-8e52-4935-a529-ca8a9fb21096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.542877 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-df4463f1-8e52-4935-a529-ca8a9fb21096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:16.551779 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-df4463f1-8e52-4935-a529-ca8a9fb21096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1558 microversion: 2.1 time: 0.181199 Jun 03 15:32:16.552559 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 373/768] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:16 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:16.558182 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-359666f9-82cf-4f36-af9d-c743dee14365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:16.558945 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-359666f9-82cf-4f36-af9d-c743dee14365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:16.566258 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-359666f9-82cf-4f36-af9d-c743dee14365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.566981 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-359666f9-82cf-4f36-af9d-c743dee14365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.567832 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-359666f9-82cf-4f36-af9d-c743dee14365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.568366 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-359666f9-82cf-4f36-af9d-c743dee14365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.626461 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6370b182-608e-4d96-8397-ec7b474331af tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "POST /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/action" status: 202 len: 0 microversion: 2.20 time: 0.339607 Jun 03 15:32:16.629944 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 396/769] 10.222.0.93 () {62 vars in 1318 bytes} [Fri Jun 3 15:32:16 2022] POST /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:32:16.632133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-542fb336-23be-4547-a704-edc458479419 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:16.632708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-542fb336-23be-4547-a704-edc458479419 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:16.639366 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-542fb336-23be-4547-a704-edc458479419 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.639815 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-542fb336-23be-4547-a704-edc458479419 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.640589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-542fb336-23be-4547-a704-edc458479419 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.641026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-542fb336-23be-4547-a704-edc458479419 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.725188 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-359666f9-82cf-4f36-af9d-c743dee14365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:16.734758 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-359666f9-82cf-4f36-af9d-c743dee14365 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.180060 Jun 03 15:32:16.735032 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 374/770] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:16 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:16.739605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-82785839-adbb-4680-8c9b-00460d6d55f2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:16.740199 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-82785839-adbb-4680-8c9b-00460d6d55f2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:16.740759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-542fb336-23be-4547-a704-edc458479419 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112423 Jun 03 15:32:16.741587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 397/771] 10.222.0.93 () {58 vars in 1274 bytes} [Fri Jun 3 15:32:16 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:16.746438 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-82785839-adbb-4680-8c9b-00460d6d55f2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.747045 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-82785839-adbb-4680-8c9b-00460d6d55f2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.747825 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-82785839-adbb-4680-8c9b-00460d6d55f2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.748263 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-82785839-adbb-4680-8c9b-00460d6d55f2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.838621 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5aec731c-6c53-4800-87d4-b1cdd025302a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:16.840429 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5aec731c-6c53-4800-87d4-b1cdd025302a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: 758b095c-6da9-4d53-abba-6a13a7c50904] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:16.848507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5aec731c-6c53-4800-87d4-b1cdd025302a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.849089 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5aec731c-6c53-4800-87d4-b1cdd025302a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.849996 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5aec731c-6c53-4800-87d4-b1cdd025302a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.850637 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5aec731c-6c53-4800-87d4-b1cdd025302a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.867123 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-5aec731c-6c53-4800-87d4-b1cdd025302a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] HTTP exception thrown: Instance 758b095c-6da9-4d53-abba-6a13a7c50904 could not be found. Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5aec731c-6c53-4800-87d4-b1cdd025302a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Request method failure captured: Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 HTTP/1.1 Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimihFnnSpT9vHcDE8w6rETruaBiPqie-4gBLlICtuPxNIrX0L7M8mdfgmZlPQf6rvIjW8Fnhg2auvD99GfAJ0MDd3ZgsJRSnPycIpx0d5syjzQnhKJUa-jr3zhJXj3ZKMz4Ll2eHi5iI_vUx_dL-hj77lNzuSckrOXnuBrt6wdhuCS6g Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: a402ec1153624838be07cda58279f2a4 Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:32:16.868939 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a402ec1153624838be07cda58279f2a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a402ec1153624838be07cda58279f2a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a402ec1153624838be07cda58279f2a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a402ec1153624838be07cda58279f2a4"}]}] Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: a402ec1153624838be07cda58279f2a4 Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-ServerRescueNegativeTestJSON-2095995501-project Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 127a6938bc5c4416a9a502d9064344cd Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2095995501-project Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 758b095c-6da9-4d53-abba-6a13a7c50904 could not be found. Jun 03 15:32:16.870487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '758b095c-6da9-4d53-abba-6a13a7c50904'} Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758b095c-6da9-4d53-abba-6a13a7c50904 could not be found. Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:32:16.871378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758b095c-6da9-4d53-abba-6a13a7c50904 could not be found. Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758b095c-6da9-4d53-abba-6a13a7c50904 could not be found. Jun 03 15:32:16.872791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:32:16.874187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5aec731c-6c53-4800-87d4-b1cdd025302a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Returning 404 to user: Instance 758b095c-6da9-4d53-abba-6a13a7c50904 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:32:16.874970 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5aec731c-6c53-4800-87d4-b1cdd025302a tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904" status: 404 len: 111 microversion: 2.1 time: 0.042068 Jun 03 15:32:16.875931 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 398/772] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:16 2022] GET /compute/v2.1/servers/758b095c-6da9-4d53-abba-6a13a7c50904 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:32:16.886690 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-35e40db3-510e-4fed-9ddb-13ea2dca9cf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:16.887427 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-35e40db3-510e-4fed-9ddb-13ea2dca9cf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:16.895114 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-35e40db3-510e-4fed-9ddb-13ea2dca9cf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.895797 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-35e40db3-510e-4fed-9ddb-13ea2dca9cf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.896825 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-35e40db3-510e-4fed-9ddb-13ea2dca9cf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.897389 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-35e40db3-510e-4fed-9ddb-13ea2dca9cf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:16.918371 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-82785839-adbb-4680-8c9b-00460d6d55f2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:16.924767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:16.929883 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-35e40db3-510e-4fed-9ddb-13ea2dca9cf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Going to try to terminate instance {{(pid=117806) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:32:16.934419 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-82785839-adbb-4680-8c9b-00460d6d55f2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:16.935989 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-82785839-adbb-4680-8c9b-00460d6d55f2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:16.937206 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-82785839-adbb-4680-8c9b-00460d6d55f2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.201256 Jun 03 15:32:16.937761 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 375/773] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:16 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:16.990497 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1d03ff8b-d9f9-489c-9756-1e20b85727f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:16.991378 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1d03ff8b-d9f9-489c-9756-1e20b85727f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:16.998049 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d03ff8b-d9f9-489c-9756-1e20b85727f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:16.998919 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d03ff8b-d9f9-489c-9756-1e20b85727f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:17.000504 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d03ff8b-d9f9-489c-9756-1e20b85727f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:17.001142 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d03ff8b-d9f9-489c-9756-1e20b85727f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:17.012362 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-35e40db3-510e-4fed-9ddb-13ea2dca9cf0 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 204 len: 0 microversion: 2.1 time: 0.132297 Jun 03 15:32:17.013112 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 399/774] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:32:16 2022] DELETE /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:32:17.022307 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5c7e53a4-babe-44e3-bc60-2a060878cf29 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:17.023179 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5c7e53a4-babe-44e3-bc60-2a060878cf29 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:17.029374 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c7e53a4-babe-44e3-bc60-2a060878cf29 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:17.030455 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c7e53a4-babe-44e3-bc60-2a060878cf29 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:17.031324 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c7e53a4-babe-44e3-bc60-2a060878cf29 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:17.031861 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c7e53a4-babe-44e3-bc60-2a060878cf29 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:17.135321 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-1d03ff8b-d9f9-489c-9756-1e20b85727f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:17.143794 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1d03ff8b-d9f9-489c-9756-1e20b85727f9 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.157484 Jun 03 15:32:17.144374 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 376/775] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:16 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:17.303936 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5c7e53a4-babe-44e3-bc60-2a060878cf29 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:17.312074 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5c7e53a4-babe-44e3-bc60-2a060878cf29 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.294172 Jun 03 15:32:17.312643 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 400/776] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:17 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:17.752988 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-baf41838-e992-44c3-b709-3b41f6467d51 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:17.753966 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-baf41838-e992-44c3-b709-3b41f6467d51 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:17.761580 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-baf41838-e992-44c3-b709-3b41f6467d51 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:17.762134 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-baf41838-e992-44c3-b709-3b41f6467d51 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:17.763059 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-baf41838-e992-44c3-b709-3b41f6467d51 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:17.763856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-baf41838-e992-44c3-b709-3b41f6467d51 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:17.797882 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-5db60755-cfa2-46a2-9b07-4738ee98350f req-6fae43f6-a4fb-4d36-9c5a-b862f72179a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f911eff-09ff-4dd0-8c61-7798cc9ad53f", "tag": "b04e40b4-2410-4984-b7d1-f08887d6d894"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:17.806418 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-5db60755-cfa2-46a2-9b07-4738ee98350f req-6fae43f6-a4fb-4d36-9c5a-b862f72179a4 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:17.806913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-5db60755-cfa2-46a2-9b07-4738ee98350f req-6fae43f6-a4fb-4d36-9c5a-b862f72179a4 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:17.819813 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-5db60755-cfa2-46a2-9b07-4738ee98350f req-6fae43f6-a4fb-4d36-9c5a-b862f72179a4 service nova] Creating event network-changed:b04e40b4-2410-4984-b7d1-f08887d6d894 for instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f on hv-cinder-83124 Jun 03 15:32:17.824852 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-5db60755-cfa2-46a2-9b07-4738ee98350f req-6fae43f6-a4fb-4d36-9c5a-b862f72179a4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031079 Jun 03 15:32:17.825465 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 401/777] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:17.912378 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-baf41838-e992-44c3-b709-3b41f6467d51 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:17.920058 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-baf41838-e992-44c3-b709-3b41f6467d51 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.172486 Jun 03 15:32:17.921227 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 377/778] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:17 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:17.956702 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-77c81c55-1ac3-42e7-962f-b3d76c372cb5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:17.957517 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-77c81c55-1ac3-42e7-962f-b3d76c372cb5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:17.963795 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-77c81c55-1ac3-42e7-962f-b3d76c372cb5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:17.964250 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-77c81c55-1ac3-42e7-962f-b3d76c372cb5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:17.965026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-77c81c55-1ac3-42e7-962f-b3d76c372cb5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:17.965546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-77c81c55-1ac3-42e7-962f-b3d76c372cb5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:18.109821 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-77c81c55-1ac3-42e7-962f-b3d76c372cb5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:18.117747 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-77c81c55-1ac3-42e7-962f-b3d76c372cb5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:18.119417 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-77c81c55-1ac3-42e7-962f-b3d76c372cb5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:18.120582 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-77c81c55-1ac3-42e7-962f-b3d76c372cb5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.168636 Jun 03 15:32:18.121136 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 402/779] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:17 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:18.161574 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4e0b04db-99bb-4407-a13b-90e146ff7a9d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:18.162217 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4e0b04db-99bb-4407-a13b-90e146ff7a9d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:18.168668 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e0b04db-99bb-4407-a13b-90e146ff7a9d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:18.169123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e0b04db-99bb-4407-a13b-90e146ff7a9d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:18.170201 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e0b04db-99bb-4407-a13b-90e146ff7a9d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:18.171093 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4e0b04db-99bb-4407-a13b-90e146ff7a9d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:18.316370 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4e0b04db-99bb-4407-a13b-90e146ff7a9d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:18.324634 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4e0b04db-99bb-4407-a13b-90e146ff7a9d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.166839 Jun 03 15:32:18.325510 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 378/780] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:18 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:18.329313 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3502267b-9f43-4148-9f78-3c0dec6e25f3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:18.330086 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3502267b-9f43-4148-9f78-3c0dec6e25f3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:18.336338 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3502267b-9f43-4148-9f78-3c0dec6e25f3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:18.336787 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3502267b-9f43-4148-9f78-3c0dec6e25f3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:18.337564 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3502267b-9f43-4148-9f78-3c0dec6e25f3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:18.338000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3502267b-9f43-4148-9f78-3c0dec6e25f3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:18.479240 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3502267b-9f43-4148-9f78-3c0dec6e25f3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:18.487569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3502267b-9f43-4148-9f78-3c0dec6e25f3 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.162261 Jun 03 15:32:18.488341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 403/781] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:18 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:18.660036 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-4185c584-ea68-4fb6-beac-cef795b7a99c req-ce8d3886-e3c8-47fe-ab6c-1f84e4c79ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b12e6d4-7911-4c08-a28d-aadf2beda784", "name": "network-vif-plugged", "status": "completed", "tag": "7520f1aa-d4f8-4c3e-9b98-3e91e6261e2c"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:18.669187 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-4185c584-ea68-4fb6-beac-cef795b7a99c req-ce8d3886-e3c8-47fe-ab6c-1f84e4c79ae5 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:18.669629 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-4185c584-ea68-4fb6-beac-cef795b7a99c req-ce8d3886-e3c8-47fe-ab6c-1f84e4c79ae5 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:18.682070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-4185c584-ea68-4fb6-beac-cef795b7a99c req-ce8d3886-e3c8-47fe-ab6c-1f84e4c79ae5 service nova] Creating event network-vif-plugged:7520f1aa-d4f8-4c3e-9b98-3e91e6261e2c for instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 on hv-cinder-83124 Jun 03 15:32:18.686814 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-4185c584-ea68-4fb6-beac-cef795b7a99c req-ce8d3886-e3c8-47fe-ab6c-1f84e4c79ae5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030449 Jun 03 15:32:18.687412 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 379/782] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:18.937873 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-70636bc4-5102-4854-9408-32dc19e13aab tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:18.938491 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-70636bc4-5102-4854-9408-32dc19e13aab tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:18.945369 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70636bc4-5102-4854-9408-32dc19e13aab tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:18.945814 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70636bc4-5102-4854-9408-32dc19e13aab tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:18.946636 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70636bc4-5102-4854-9408-32dc19e13aab tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:18.947079 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70636bc4-5102-4854-9408-32dc19e13aab tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:19.081792 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-70636bc4-5102-4854-9408-32dc19e13aab tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:19.089278 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-70636bc4-5102-4854-9408-32dc19e13aab tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.155214 Jun 03 15:32:19.089774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 404/783] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:18 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:19.141049 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-148bc64d-88df-4e2f-bc86-87fd57abfd35 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:19.141750 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-148bc64d-88df-4e2f-bc86-87fd57abfd35 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:19.148088 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-148bc64d-88df-4e2f-bc86-87fd57abfd35 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:19.148537 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-148bc64d-88df-4e2f-bc86-87fd57abfd35 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:19.149757 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-148bc64d-88df-4e2f-bc86-87fd57abfd35 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:19.150020 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-148bc64d-88df-4e2f-bc86-87fd57abfd35 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:19.285039 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-148bc64d-88df-4e2f-bc86-87fd57abfd35 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:19.292965 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-148bc64d-88df-4e2f-bc86-87fd57abfd35 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:19.294479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-148bc64d-88df-4e2f-bc86-87fd57abfd35 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:19.296435 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-148bc64d-88df-4e2f-bc86-87fd57abfd35 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.160374 Jun 03 15:32:19.296881 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 380/784] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:19 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:19.343029 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-aa8ad0fe-a8fe-472e-9529-9eb11936d40c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:19.343640 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-aa8ad0fe-a8fe-472e-9529-9eb11936d40c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:19.352930 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aa8ad0fe-a8fe-472e-9529-9eb11936d40c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:19.353383 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aa8ad0fe-a8fe-472e-9529-9eb11936d40c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:19.354160 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aa8ad0fe-a8fe-472e-9529-9eb11936d40c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:19.355255 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aa8ad0fe-a8fe-472e-9529-9eb11936d40c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:19.486830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-aa8ad0fe-a8fe-472e-9529-9eb11936d40c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:19.494198 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-aa8ad0fe-a8fe-472e-9529-9eb11936d40c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.155790 Jun 03 15:32:19.494791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 405/785] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:19 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:19.504595 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-55254c49-775f-412c-a80b-1fd5ab7a082f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:19.505195 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-55254c49-775f-412c-a80b-1fd5ab7a082f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:19.511284 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-55254c49-775f-412c-a80b-1fd5ab7a082f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:19.511757 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-55254c49-775f-412c-a80b-1fd5ab7a082f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:19.512558 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-55254c49-775f-412c-a80b-1fd5ab7a082f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:19.512993 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-55254c49-775f-412c-a80b-1fd5ab7a082f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:19.656735 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-55254c49-775f-412c-a80b-1fd5ab7a082f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:19.664432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-55254c49-775f-412c-a80b-1fd5ab7a082f tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.163659 Jun 03 15:32:19.665308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 381/786] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:19 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:20.106841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-154a9161-cc05-454c-a432-220af997a5b3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:20.107458 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-154a9161-cc05-454c-a432-220af997a5b3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:20.114506 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-154a9161-cc05-454c-a432-220af997a5b3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:20.114984 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-154a9161-cc05-454c-a432-220af997a5b3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:20.115751 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-154a9161-cc05-454c-a432-220af997a5b3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:20.116195 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-154a9161-cc05-454c-a432-220af997a5b3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:20.244809 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-154a9161-cc05-454c-a432-220af997a5b3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:20.253001 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-154a9161-cc05-454c-a432-220af997a5b3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.150257 Jun 03 15:32:20.253566 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 406/787] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:20 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:20.315049 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a341c1a4-bca6-40fa-9aa4-31e81c8ca150 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:20.315569 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a341c1a4-bca6-40fa-9aa4-31e81c8ca150 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:20.322166 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a341c1a4-bca6-40fa-9aa4-31e81c8ca150 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:20.322647 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a341c1a4-bca6-40fa-9aa4-31e81c8ca150 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:20.323411 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a341c1a4-bca6-40fa-9aa4-31e81c8ca150 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:20.323844 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a341c1a4-bca6-40fa-9aa4-31e81c8ca150 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:20.459032 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a341c1a4-bca6-40fa-9aa4-31e81c8ca150 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:20.467857 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a341c1a4-bca6-40fa-9aa4-31e81c8ca150 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:20.469430 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a341c1a4-bca6-40fa-9aa4-31e81c8ca150 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:20.470645 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a341c1a4-bca6-40fa-9aa4-31e81c8ca150 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.160183 Jun 03 15:32:20.471211 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 382/788] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:20 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:20.510070 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-873bb419-1974-45f2-a6d0-4acda4f07d19 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:20.510767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-873bb419-1974-45f2-a6d0-4acda4f07d19 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:20.517559 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-873bb419-1974-45f2-a6d0-4acda4f07d19 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:20.518073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-873bb419-1974-45f2-a6d0-4acda4f07d19 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:20.518942 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-873bb419-1974-45f2-a6d0-4acda4f07d19 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:20.519384 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-873bb419-1974-45f2-a6d0-4acda4f07d19 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:20.646985 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-873bb419-1974-45f2-a6d0-4acda4f07d19 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:20.654948 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-873bb419-1974-45f2-a6d0-4acda4f07d19 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1363 microversion: 2.1 time: 0.148204 Jun 03 15:32:20.655561 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 407/789] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:20 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:20.681065 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4832df9c-5c3b-49b7-ad87-7bba08df1886 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:20.681670 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4832df9c-5c3b-49b7-ad87-7bba08df1886 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:20.687889 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4832df9c-5c3b-49b7-ad87-7bba08df1886 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:20.688416 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4832df9c-5c3b-49b7-ad87-7bba08df1886 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:20.689176 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4832df9c-5c3b-49b7-ad87-7bba08df1886 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:20.689611 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4832df9c-5c3b-49b7-ad87-7bba08df1886 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:20.820119 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4832df9c-5c3b-49b7-ad87-7bba08df1886 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:20.828116 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4832df9c-5c3b-49b7-ad87-7bba08df1886 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.150865 Jun 03 15:32:20.828685 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 383/790] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:20 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:21.270883 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-be438f52-d69d-4ec8-8723-cdaeb9008ee5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:21.271493 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-be438f52-d69d-4ec8-8723-cdaeb9008ee5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:21.278098 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-be438f52-d69d-4ec8-8723-cdaeb9008ee5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:21.278570 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-be438f52-d69d-4ec8-8723-cdaeb9008ee5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:21.279373 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-be438f52-d69d-4ec8-8723-cdaeb9008ee5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:21.279815 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-be438f52-d69d-4ec8-8723-cdaeb9008ee5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:21.415768 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-be438f52-d69d-4ec8-8723-cdaeb9008ee5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:21.424032 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-be438f52-d69d-4ec8-8723-cdaeb9008ee5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.156951 Jun 03 15:32:21.424598 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 408/791] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:21 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:21.489922 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-dea0e3a9-8b4e-47e9-b8e4-2d2c2402e154 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:21.490547 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-dea0e3a9-8b4e-47e9-b8e4-2d2c2402e154 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:21.497110 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dea0e3a9-8b4e-47e9-b8e4-2d2c2402e154 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:21.497560 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dea0e3a9-8b4e-47e9-b8e4-2d2c2402e154 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:21.499041 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dea0e3a9-8b4e-47e9-b8e4-2d2c2402e154 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:21.499331 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dea0e3a9-8b4e-47e9-b8e4-2d2c2402e154 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:21.634202 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dea0e3a9-8b4e-47e9-b8e4-2d2c2402e154 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:21.642791 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dea0e3a9-8b4e-47e9-b8e4-2d2c2402e154 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:21.644326 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-dea0e3a9-8b4e-47e9-b8e4-2d2c2402e154 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:21.645507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-dea0e3a9-8b4e-47e9-b8e4-2d2c2402e154 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.159580 Jun 03 15:32:21.646057 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 384/792] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:21 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:21.672449 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b9959935-3d46-475c-ab50-707f5e6ece8d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:21.673059 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b9959935-3d46-475c-ab50-707f5e6ece8d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:21.675191 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:21.680639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b9959935-3d46-475c-ab50-707f5e6ece8d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:21.681089 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b9959935-3d46-475c-ab50-707f5e6ece8d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:21.681925 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b9959935-3d46-475c-ab50-707f5e6ece8d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:21.682360 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b9959935-3d46-475c-ab50-707f5e6ece8d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:21.845684 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d540dd9f-86a0-45c0-af67-c15320775bef tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:21.846389 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d540dd9f-86a0-45c0-af67-c15320775bef tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:21.852597 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d540dd9f-86a0-45c0-af67-c15320775bef tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:21.853131 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d540dd9f-86a0-45c0-af67-c15320775bef tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:21.853976 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d540dd9f-86a0-45c0-af67-c15320775bef tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:21.854577 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d540dd9f-86a0-45c0-af67-c15320775bef tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:21.931613 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-b9959935-3d46-475c-ab50-707f5e6ece8d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:21.939430 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b9959935-3d46-475c-ab50-707f5e6ece8d tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1549 microversion: 2.1 time: 0.271553 Jun 03 15:32:21.940003 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 409/793] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:21 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1549 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:21.955662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-cec4652c-2594-46a8-ad61-b7aea187710e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:21.956196 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-cec4652c-2594-46a8-ad61-b7aea187710e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:21.962244 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cec4652c-2594-46a8-ad61-b7aea187710e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:21.962740 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cec4652c-2594-46a8-ad61-b7aea187710e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:21.963512 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cec4652c-2594-46a8-ad61-b7aea187710e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:21.963956 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cec4652c-2594-46a8-ad61-b7aea187710e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:22.042669 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-cec4652c-2594-46a8-ad61-b7aea187710e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090701 Jun 03 15:32:22.043483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 410/794] 10.222.0.93 () {58 vars in 1274 bytes} [Fri Jun 3 15:32:21 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:32:22.068918 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d540dd9f-86a0-45c0-af67-c15320775bef tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:22.077436 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d540dd9f-86a0-45c0-af67-c15320775bef tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1522 microversion: 2.1 time: 0.235937 Jun 03 15:32:22.079242 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 385/795] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:21 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:32:22.236561 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-8df9dd1e-a1bf-45c1-bffc-8b77d14810a2 req-9920c90b-5c76-45c2-812b-5f8fdfcc67a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3", "name": "network-vif-deleted", "tag": "d4a71b7c-b829-4818-a730-8eda807ebe70"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:22.245300 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-8df9dd1e-a1bf-45c1-bffc-8b77d14810a2 req-9920c90b-5c76-45c2-812b-5f8fdfcc67a1 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:22.245851 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-8df9dd1e-a1bf-45c1-bffc-8b77d14810a2 req-9920c90b-5c76-45c2-812b-5f8fdfcc67a1 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:22.257718 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-8df9dd1e-a1bf-45c1-bffc-8b77d14810a2 req-9920c90b-5c76-45c2-812b-5f8fdfcc67a1 service nova] Creating event network-vif-deleted:d4a71b7c-b829-4818-a730-8eda807ebe70 for instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 on hv-cinder-83124 Jun 03 15:32:22.263057 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-8df9dd1e-a1bf-45c1-bffc-8b77d14810a2 req-9920c90b-5c76-45c2-812b-5f8fdfcc67a1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031373 Jun 03 15:32:22.264050 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 411/796] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:22.441202 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3d998e56-9e9b-49bd-8e47-86430f3ffbf8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:22.441866 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3d998e56-9e9b-49bd-8e47-86430f3ffbf8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:22.449426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d998e56-9e9b-49bd-8e47-86430f3ffbf8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:22.449881 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d998e56-9e9b-49bd-8e47-86430f3ffbf8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:22.450892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d998e56-9e9b-49bd-8e47-86430f3ffbf8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:22.451903 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d998e56-9e9b-49bd-8e47-86430f3ffbf8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:22.456708 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=100 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:22.616360 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-3d998e56-9e9b-49bd-8e47-86430f3ffbf8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:22.624768 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3d998e56-9e9b-49bd-8e47-86430f3ffbf8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1265 microversion: 2.1 time: 0.187639 Jun 03 15:32:22.625379 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 386/797] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:22 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:22.664999 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1168373d-08c4-401e-81e7-cdbe29d021e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:22.665700 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1168373d-08c4-401e-81e7-cdbe29d021e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:22.678163 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1168373d-08c4-401e-81e7-cdbe29d021e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:22.679415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1168373d-08c4-401e-81e7-cdbe29d021e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:22.680302 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1168373d-08c4-401e-81e7-cdbe29d021e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:22.681008 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1168373d-08c4-401e-81e7-cdbe29d021e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:23.096051 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:23.097204 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:23.103183 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:23.103641 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:23.104422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:23.104865 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:23.136023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:23.136471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:23.136928 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lazy-loading 'fault' on Instance uuid cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:32:23.183227 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a6938bc5c4416a9a502d9064344cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a402ec1153624838be07cda58279f2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:23.207189 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-45bccff9-4d73-4cab-b420-81ea70912e6d tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 200 len: 1312 microversion: 2.1 time: 0.115602 Jun 03 15:32:23.208947 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 387/798] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:23 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:23.244411 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1168373d-08c4-401e-81e7-cdbe29d021e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:23.253193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1168373d-08c4-401e-81e7-cdbe29d021e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:23.254727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1168373d-08c4-401e-81e7-cdbe29d021e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:23.255891 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1168373d-08c4-401e-81e7-cdbe29d021e6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.595714 Jun 03 15:32:23.256444 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 412/799] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:22 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:23.608684 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-89dee192-a918-42f1-adbf-a2ad8da83bc0 req-3592f5e5-e304-4b1f-a057-4958ba869b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "697213d5-1b86-415b-bba2-8c09be059aae", "tag": "017c3110-af95-4653-ab4b-2de2cf82c63b"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:23.616845 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-89dee192-a918-42f1-adbf-a2ad8da83bc0 req-3592f5e5-e304-4b1f-a057-4958ba869b05 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:23.617450 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-89dee192-a918-42f1-adbf-a2ad8da83bc0 req-3592f5e5-e304-4b1f-a057-4958ba869b05 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:23.628961 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-89dee192-a918-42f1-adbf-a2ad8da83bc0 req-3592f5e5-e304-4b1f-a057-4958ba869b05 service nova] Creating event network-changed:017c3110-af95-4653-ab4b-2de2cf82c63b for instance 697213d5-1b86-415b-bba2-8c09be059aae on hv-cinder-83124 Jun 03 15:32:23.633673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-89dee192-a918-42f1-adbf-a2ad8da83bc0 req-3592f5e5-e304-4b1f-a057-4958ba869b05 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084693 Jun 03 15:32:23.634257 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 388/800] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:23.641822 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-008f1fd5-a266-40fc-aa64-85c6d901a0fb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:23.642469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-008f1fd5-a266-40fc-aa64-85c6d901a0fb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:23.656721 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-008f1fd5-a266-40fc-aa64-85c6d901a0fb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:23.657197 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-008f1fd5-a266-40fc-aa64-85c6d901a0fb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:23.657987 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-008f1fd5-a266-40fc-aa64-85c6d901a0fb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:23.658428 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-008f1fd5-a266-40fc-aa64-85c6d901a0fb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:23.908841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-008f1fd5-a266-40fc-aa64-85c6d901a0fb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:23.919032 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-008f1fd5-a266-40fc-aa64-85c6d901a0fb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1452 microversion: 2.1 time: 0.281660 Jun 03 15:32:23.919607 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 413/801] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:23 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1452 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:23.937678 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6a61547e-70b6-4577-9f60-f43b60b8dca2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:23.938396 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6a61547e-70b6-4577-9f60-f43b60b8dca2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:23.945322 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6a61547e-70b6-4577-9f60-f43b60b8dca2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:23.946041 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6a61547e-70b6-4577-9f60-f43b60b8dca2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:23.946847 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6a61547e-70b6-4577-9f60-f43b60b8dca2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:23.947283 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6a61547e-70b6-4577-9f60-f43b60b8dca2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:24.162961 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6a61547e-70b6-4577-9f60-f43b60b8dca2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:24.172285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6a61547e-70b6-4577-9f60-f43b60b8dca2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1452 microversion: 2.1 time: 0.239434 Jun 03 15:32:24.172866 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 389/802] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:23 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:32:24.230283 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-38c95f19-3c8a-4fc7-9ab5-bb22aa650e33 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:24.231406 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-38c95f19-3c8a-4fc7-9ab5-bb22aa650e33 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] [instance: cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:24.239894 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-38c95f19-3c8a-4fc7-9ab5-bb22aa650e33 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:24.241139 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-38c95f19-3c8a-4fc7-9ab5-bb22aa650e33 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:24.242095 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-38c95f19-3c8a-4fc7-9ab5-bb22aa650e33 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:24.242759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-38c95f19-3c8a-4fc7-9ab5-bb22aa650e33 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:24.258663 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-38c95f19-3c8a-4fc7-9ab5-bb22aa650e33 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] HTTP exception thrown: Instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 could not be found. Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-38c95f19-3c8a-4fc7-9ab5-bb22aa650e33 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Request method failure captured: Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 HTTP/1.1 Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimihFnnSpT9vHcDE8w6rETruaBiPqie-4gBLlICtuPxNIrX0L7M8mdfgmZlPQf6rvIjW8Fnhg2auvD99GfAJ0MDd3ZgsJRSnPycIpx0d5syjzQnhKJUa-jr3zhJXj3ZKMz4Ll2eHi5iI_vUx_dL-hj77lNzuSckrOXnuBrt6wdhuCS6g Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: a402ec1153624838be07cda58279f2a4 Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:32:24.260525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a402ec1153624838be07cda58279f2a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a402ec1153624838be07cda58279f2a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a402ec1153624838be07cda58279f2a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a402ec1153624838be07cda58279f2a4"}]}] Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: a402ec1153624838be07cda58279f2a4 Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2095995501 Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-ServerRescueNegativeTestJSON-2095995501-project Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 127a6938bc5c4416a9a502d9064344cd Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2095995501-project Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 could not be found. Jun 03 15:32:24.262385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3'} Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 could not be found. Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:32:24.263594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 could not be found. Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 could not be found. Jun 03 15:32:24.265090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:32:24.267487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-38c95f19-3c8a-4fc7-9ab5-bb22aa650e33 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] Returning 404 to user: Instance cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:32:24.268505 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-38c95f19-3c8a-4fc7-9ab5-bb22aa650e33 tempest-ServerRescueNegativeTestJSON-2095995501 tempest-ServerRescueNegativeTestJSON-2095995501-project] 10.222.0.93 "GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3" status: 404 len: 111 microversion: 2.1 time: 0.045077 Jun 03 15:32:24.272947 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 414/803] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:32:24 2022] GET /compute/v2.1/servers/cc122a7e-fe3b-4bb6-abb6-96e6a199d8e3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:32:24.276796 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-29bc81ef-acea-422f-86e9-5b284c4b765b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:24.277891 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-29bc81ef-acea-422f-86e9-5b284c4b765b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:24.292077 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29bc81ef-acea-422f-86e9-5b284c4b765b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:24.294294 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29bc81ef-acea-422f-86e9-5b284c4b765b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:24.296145 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29bc81ef-acea-422f-86e9-5b284c4b765b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:24.297916 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29bc81ef-acea-422f-86e9-5b284c4b765b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:24.498511 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-29bc81ef-acea-422f-86e9-5b284c4b765b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:24.506824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-29bc81ef-acea-422f-86e9-5b284c4b765b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:24.508331 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-29bc81ef-acea-422f-86e9-5b284c4b765b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:24.509501 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-29bc81ef-acea-422f-86e9-5b284c4b765b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.237808 Jun 03 15:32:24.510060 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 390/804] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:24 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:25.530159 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-aaac3626-408e-46fa-aec0-d53736b89184 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:25.531306 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-aaac3626-408e-46fa-aec0-d53736b89184 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:25.537926 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aaac3626-408e-46fa-aec0-d53736b89184 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:25.538407 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aaac3626-408e-46fa-aec0-d53736b89184 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:25.539223 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aaac3626-408e-46fa-aec0-d53736b89184 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:25.539663 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aaac3626-408e-46fa-aec0-d53736b89184 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:26.068736 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-aaac3626-408e-46fa-aec0-d53736b89184 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:26.077041 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-aaac3626-408e-46fa-aec0-d53736b89184 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:26.078686 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-aaac3626-408e-46fa-aec0-d53736b89184 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:26.079893 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-aaac3626-408e-46fa-aec0-d53736b89184 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.555237 Jun 03 15:32:26.080777 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 415/805] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:25 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:27.098902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6bd7b0fc-dbcf-4dab-922e-27347720cdc8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:27.099443 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6bd7b0fc-dbcf-4dab-922e-27347720cdc8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:27.106191 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6bd7b0fc-dbcf-4dab-922e-27347720cdc8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:27.106670 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6bd7b0fc-dbcf-4dab-922e-27347720cdc8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:27.107536 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6bd7b0fc-dbcf-4dab-922e-27347720cdc8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:27.107997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6bd7b0fc-dbcf-4dab-922e-27347720cdc8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:27.265049 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6bd7b0fc-dbcf-4dab-922e-27347720cdc8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:27.274089 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6bd7b0fc-dbcf-4dab-922e-27347720cdc8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:27.276056 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6bd7b0fc-dbcf-4dab-922e-27347720cdc8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:27.277369 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6bd7b0fc-dbcf-4dab-922e-27347720cdc8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.182559 Jun 03 15:32:27.277936 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 391/806] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:27 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:27.534464 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-438afbdb-fd5e-41c3-a1d4-12f72477cff5 req-ce85fb72-27ba-4798-9888-645801bac433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b12e6d4-7911-4c08-a28d-aadf2beda784", "tag": "7520f1aa-d4f8-4c3e-9b98-3e91e6261e2c"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:27.558913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-438afbdb-fd5e-41c3-a1d4-12f72477cff5 req-ce85fb72-27ba-4798-9888-645801bac433 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:27.559977 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-438afbdb-fd5e-41c3-a1d4-12f72477cff5 req-ce85fb72-27ba-4798-9888-645801bac433 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:27.586221 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-438afbdb-fd5e-41c3-a1d4-12f72477cff5 req-ce85fb72-27ba-4798-9888-645801bac433 service nova] Creating event network-changed:7520f1aa-d4f8-4c3e-9b98-3e91e6261e2c for instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 on hv-cinder-83124 Jun 03 15:32:27.596529 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-438afbdb-fd5e-41c3-a1d4-12f72477cff5 req-ce85fb72-27ba-4798-9888-645801bac433 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068854 Jun 03 15:32:27.598650 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 416/807] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:28.296565 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-29f17b1f-26a7-4d52-ba8b-e1a07c3e421a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:28.297455 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-29f17b1f-26a7-4d52-ba8b-e1a07c3e421a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:28.304618 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29f17b1f-26a7-4d52-ba8b-e1a07c3e421a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:28.305152 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29f17b1f-26a7-4d52-ba8b-e1a07c3e421a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:28.306146 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29f17b1f-26a7-4d52-ba8b-e1a07c3e421a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:28.306894 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-29f17b1f-26a7-4d52-ba8b-e1a07c3e421a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:28.472840 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-29f17b1f-26a7-4d52-ba8b-e1a07c3e421a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:28.482175 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-29f17b1f-26a7-4d52-ba8b-e1a07c3e421a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:28.484453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-29f17b1f-26a7-4d52-ba8b-e1a07c3e421a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:28.485630 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-29f17b1f-26a7-4d52-ba8b-e1a07c3e421a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.193802 Jun 03 15:32:28.486191 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 392/808] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:28 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:29.504515 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e0e884ba-c127-46f9-80f7-594eb4bb3ddf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:29.505205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e0e884ba-c127-46f9-80f7-594eb4bb3ddf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:29.511840 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0e884ba-c127-46f9-80f7-594eb4bb3ddf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:29.512284 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0e884ba-c127-46f9-80f7-594eb4bb3ddf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:29.513297 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0e884ba-c127-46f9-80f7-594eb4bb3ddf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:29.514049 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0e884ba-c127-46f9-80f7-594eb4bb3ddf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:29.516847 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:29.656648 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e0e884ba-c127-46f9-80f7-594eb4bb3ddf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:29.666958 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e0e884ba-c127-46f9-80f7-594eb4bb3ddf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:29.668555 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e0e884ba-c127-46f9-80f7-594eb4bb3ddf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:29.670382 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e0e884ba-c127-46f9-80f7-594eb4bb3ddf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.170270 Jun 03 15:32:29.670975 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 417/809] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:29 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:32:30.689252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2d35528c-95cc-41d7-ae43-c50892c7e24e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:30.689870 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2d35528c-95cc-41d7-ae43-c50892c7e24e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:30.696769 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2d35528c-95cc-41d7-ae43-c50892c7e24e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:30.697228 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2d35528c-95cc-41d7-ae43-c50892c7e24e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:30.698010 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2d35528c-95cc-41d7-ae43-c50892c7e24e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:30.698471 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2d35528c-95cc-41d7-ae43-c50892c7e24e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:30.836356 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2d35528c-95cc-41d7-ae43-c50892c7e24e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:30.844488 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2d35528c-95cc-41d7-ae43-c50892c7e24e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:30.846011 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2d35528c-95cc-41d7-ae43-c50892c7e24e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:30.847224 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2d35528c-95cc-41d7-ae43-c50892c7e24e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.162591 Jun 03 15:32:30.847724 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 393/810] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:30 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:31.867072 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3fc69ee9-87af-4325-8e78-95ae1b33fc08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:31.867732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3fc69ee9-87af-4325-8e78-95ae1b33fc08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:31.875436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3fc69ee9-87af-4325-8e78-95ae1b33fc08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:31.875883 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3fc69ee9-87af-4325-8e78-95ae1b33fc08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:31.876659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3fc69ee9-87af-4325-8e78-95ae1b33fc08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:31.877095 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3fc69ee9-87af-4325-8e78-95ae1b33fc08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:32.016925 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3fc69ee9-87af-4325-8e78-95ae1b33fc08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:32.025704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3fc69ee9-87af-4325-8e78-95ae1b33fc08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:32.027697 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-3fc69ee9-87af-4325-8e78-95ae1b33fc08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:32.029035 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3fc69ee9-87af-4325-8e78-95ae1b33fc08 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.165948 Jun 03 15:32:32.029733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 418/811] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:31 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:33.047423 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d0fec77d-5403-4227-9c59-ba47b912f55b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:33.048030 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d0fec77d-5403-4227-9c59-ba47b912f55b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:33.054615 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d0fec77d-5403-4227-9c59-ba47b912f55b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:33.055064 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d0fec77d-5403-4227-9c59-ba47b912f55b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:33.055810 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d0fec77d-5403-4227-9c59-ba47b912f55b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:33.056243 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d0fec77d-5403-4227-9c59-ba47b912f55b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:33.188913 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d0fec77d-5403-4227-9c59-ba47b912f55b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:33.202785 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d0fec77d-5403-4227-9c59-ba47b912f55b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:33.204309 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d0fec77d-5403-4227-9c59-ba47b912f55b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:33.205479 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d0fec77d-5403-4227-9c59-ba47b912f55b tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1744 microversion: 2.20 time: 0.162173 Jun 03 15:32:33.206044 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 394/812] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:33 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:34.223543 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6570b165-5840-47c0-ab93-77608fbca86c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:34.224147 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6570b165-5840-47c0-ab93-77608fbca86c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:34.230714 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6570b165-5840-47c0-ab93-77608fbca86c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:34.231164 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6570b165-5840-47c0-ab93-77608fbca86c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:34.232704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6570b165-5840-47c0-ab93-77608fbca86c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:34.233140 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6570b165-5840-47c0-ab93-77608fbca86c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:34.368077 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6570b165-5840-47c0-ab93-77608fbca86c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:34.376279 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6570b165-5840-47c0-ab93-77608fbca86c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:34.377779 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6570b165-5840-47c0-ab93-77608fbca86c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:34.378964 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6570b165-5840-47c0-ab93-77608fbca86c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1744 microversion: 2.20 time: 0.159388 Jun 03 15:32:34.379517 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 419/813] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:34 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:32:35.398457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b5e32c20-c430-4b2a-ab6b-7a5dcaef1adb tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:35.399907 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b5e32c20-c430-4b2a-ab6b-7a5dcaef1adb tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:35.408140 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b5e32c20-c430-4b2a-ab6b-7a5dcaef1adb tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:35.408592 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b5e32c20-c430-4b2a-ab6b-7a5dcaef1adb tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:35.409399 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b5e32c20-c430-4b2a-ab6b-7a5dcaef1adb tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:35.410065 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b5e32c20-c430-4b2a-ab6b-7a5dcaef1adb tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:35.576842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b5e32c20-c430-4b2a-ab6b-7a5dcaef1adb tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:35.588750 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b5e32c20-c430-4b2a-ab6b-7a5dcaef1adb tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:35.591540 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b5e32c20-c430-4b2a-ab6b-7a5dcaef1adb tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:35.593339 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b5e32c20-c430-4b2a-ab6b-7a5dcaef1adb tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1739 microversion: 2.20 time: 0.198858 Jun 03 15:32:35.594256 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 395/814] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:35 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:36.405633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-7bd88f74-4ea3-4b73-999f-979afda8bf7a req-b4caac8d-5248-48e7-be11-7a0ca1f8b1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43beed7e-5952-4cc8-89ea-8c819ceb44de", "name": "network-vif-plugged", "status": "completed", "tag": "009f1a65-b949-4493-a4fc-88ecafb96c71"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:36.426767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-7bd88f74-4ea3-4b73-999f-979afda8bf7a req-b4caac8d-5248-48e7-be11-7a0ca1f8b1ec service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:36.427213 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-7bd88f74-4ea3-4b73-999f-979afda8bf7a req-b4caac8d-5248-48e7-be11-7a0ca1f8b1ec service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:36.456844 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-7bd88f74-4ea3-4b73-999f-979afda8bf7a req-b4caac8d-5248-48e7-be11-7a0ca1f8b1ec service nova] Creating event network-vif-plugged:009f1a65-b949-4493-a4fc-88ecafb96c71 for instance 43beed7e-5952-4cc8-89ea-8c819ceb44de on hv-cinder-83124 Jun 03 15:32:36.469766 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-7bd88f74-4ea3-4b73-999f-979afda8bf7a req-b4caac8d-5248-48e7-be11-7a0ca1f8b1ec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070113 Jun 03 15:32:36.470844 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 420/815] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:32:36.613531 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-fe684ff7-83ce-46d7-8e37-fdb872d29dd4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:36.614857 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-fe684ff7-83ce-46d7-8e37-fdb872d29dd4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:36.627735 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe684ff7-83ce-46d7-8e37-fdb872d29dd4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:36.628195 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe684ff7-83ce-46d7-8e37-fdb872d29dd4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:36.628989 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe684ff7-83ce-46d7-8e37-fdb872d29dd4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:36.629434 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe684ff7-83ce-46d7-8e37-fdb872d29dd4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:36.814099 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-fe684ff7-83ce-46d7-8e37-fdb872d29dd4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:36.823779 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-fe684ff7-83ce-46d7-8e37-fdb872d29dd4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:36.827365 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-fe684ff7-83ce-46d7-8e37-fdb872d29dd4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:36.828849 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-fe684ff7-83ce-46d7-8e37-fdb872d29dd4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1739 microversion: 2.20 time: 0.219504 Jun 03 15:32:36.829814 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 396/816] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:36 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:37.847178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-efa4a2b4-d675-4b83-8d37-c493b219e0fd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:37.848813 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-efa4a2b4-d675-4b83-8d37-c493b219e0fd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:37.856605 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-efa4a2b4-d675-4b83-8d37-c493b219e0fd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:37.857086 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-efa4a2b4-d675-4b83-8d37-c493b219e0fd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:37.857868 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-efa4a2b4-d675-4b83-8d37-c493b219e0fd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:37.861513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-efa4a2b4-d675-4b83-8d37-c493b219e0fd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:38.020936 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-efa4a2b4-d675-4b83-8d37-c493b219e0fd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:38.029477 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-efa4a2b4-d675-4b83-8d37-c493b219e0fd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:38.031170 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-efa4a2b4-d675-4b83-8d37-c493b219e0fd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:38.035357 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-efa4a2b4-d675-4b83-8d37-c493b219e0fd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1739 microversion: 2.20 time: 0.192024 Jun 03 15:32:38.036004 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 421/817] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:37 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:39.054398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-52354a8a-4e6a-4969-8c51-1fa753896183 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:39.055245 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-52354a8a-4e6a-4969-8c51-1fa753896183 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:39.062659 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-52354a8a-4e6a-4969-8c51-1fa753896183 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:39.063700 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-52354a8a-4e6a-4969-8c51-1fa753896183 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:39.065005 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-52354a8a-4e6a-4969-8c51-1fa753896183 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:39.065662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-52354a8a-4e6a-4969-8c51-1fa753896183 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:39.230610 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-52354a8a-4e6a-4969-8c51-1fa753896183 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:39.245144 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-52354a8a-4e6a-4969-8c51-1fa753896183 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:39.248132 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-52354a8a-4e6a-4969-8c51-1fa753896183 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:39.249626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-52354a8a-4e6a-4969-8c51-1fa753896183 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1739 microversion: 2.20 time: 0.199791 Jun 03 15:32:39.250194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 397/818] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:39 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:40.268727 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9c97ce97-ed50-42f7-af3f-f32f1a7220e3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:40.269368 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9c97ce97-ed50-42f7-af3f-f32f1a7220e3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:40.276253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c97ce97-ed50-42f7-af3f-f32f1a7220e3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:40.277024 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c97ce97-ed50-42f7-af3f-f32f1a7220e3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:40.277537 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c97ce97-ed50-42f7-af3f-f32f1a7220e3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:40.278165 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c97ce97-ed50-42f7-af3f-f32f1a7220e3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:40.425579 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9c97ce97-ed50-42f7-af3f-f32f1a7220e3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:40.433612 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9c97ce97-ed50-42f7-af3f-f32f1a7220e3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:40.435998 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9c97ce97-ed50-42f7-af3f-f32f1a7220e3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:40.437405 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9c97ce97-ed50-42f7-af3f-f32f1a7220e3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1739 microversion: 2.20 time: 0.172870 Jun 03 15:32:40.438144 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 422/819] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:40 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:41.457132 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ed858bf3-28b3-4a8b-b5c6-2864c756823d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:41.457738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ed858bf3-28b3-4a8b-b5c6-2864c756823d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:41.467881 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=90 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:41.472948 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ed858bf3-28b3-4a8b-b5c6-2864c756823d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:41.473648 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ed858bf3-28b3-4a8b-b5c6-2864c756823d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:41.474807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ed858bf3-28b3-4a8b-b5c6-2864c756823d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:41.475408 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ed858bf3-28b3-4a8b-b5c6-2864c756823d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:41.635487 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ed858bf3-28b3-4a8b-b5c6-2864c756823d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:41.647956 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ed858bf3-28b3-4a8b-b5c6-2864c756823d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:41.650359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ed858bf3-28b3-4a8b-b5c6-2864c756823d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:41.651826 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ed858bf3-28b3-4a8b-b5c6-2864c756823d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1739 microversion: 2.20 time: 0.198626 Jun 03 15:32:41.652555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 398/820] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:41 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:32:42.672781 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ef05e70d-b8c4-4dc4-8a8d-7e8ce6bfe685 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:42.673993 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ef05e70d-b8c4-4dc4-8a8d-7e8ce6bfe685 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:42.681071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef05e70d-b8c4-4dc4-8a8d-7e8ce6bfe685 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:42.681537 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef05e70d-b8c4-4dc4-8a8d-7e8ce6bfe685 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:42.682303 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef05e70d-b8c4-4dc4-8a8d-7e8ce6bfe685 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:42.682762 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef05e70d-b8c4-4dc4-8a8d-7e8ce6bfe685 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:42.846991 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ef05e70d-b8c4-4dc4-8a8d-7e8ce6bfe685 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:42.858031 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ef05e70d-b8c4-4dc4-8a8d-7e8ce6bfe685 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:42.860905 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ef05e70d-b8c4-4dc4-8a8d-7e8ce6bfe685 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:42.862408 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ef05e70d-b8c4-4dc4-8a8d-7e8ce6bfe685 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1739 microversion: 2.20 time: 0.193617 Jun 03 15:32:42.863555 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 423/821] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:42 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:43.882219 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-52de22bf-39ca-456c-89f9-16faf793361e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:43.882853 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-52de22bf-39ca-456c-89f9-16faf793361e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:43.890669 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-52de22bf-39ca-456c-89f9-16faf793361e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:43.891356 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-52de22bf-39ca-456c-89f9-16faf793361e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:43.892411 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-52de22bf-39ca-456c-89f9-16faf793361e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:43.892913 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-52de22bf-39ca-456c-89f9-16faf793361e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:44.056828 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-52de22bf-39ca-456c-89f9-16faf793361e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:44.070206 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-52de22bf-39ca-456c-89f9-16faf793361e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:44.073113 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-52de22bf-39ca-456c-89f9-16faf793361e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:44.075839 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-52de22bf-39ca-456c-89f9-16faf793361e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1739 microversion: 2.20 time: 0.196934 Jun 03 15:32:44.076991 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 399/822] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:43 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:45.099587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ef48cba3-0bfe-4080-81d5-e185f47123a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:45.100127 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ef48cba3-0bfe-4080-81d5-e185f47123a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:45.107270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef48cba3-0bfe-4080-81d5-e185f47123a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:45.107721 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef48cba3-0bfe-4080-81d5-e185f47123a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:45.108487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef48cba3-0bfe-4080-81d5-e185f47123a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:45.108932 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ef48cba3-0bfe-4080-81d5-e185f47123a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:45.240819 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ef48cba3-0bfe-4080-81d5-e185f47123a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:45.248878 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ef48cba3-0bfe-4080-81d5-e185f47123a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:45.250474 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ef48cba3-0bfe-4080-81d5-e185f47123a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:45.251668 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ef48cba3-0bfe-4080-81d5-e185f47123a3 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1721 microversion: 2.20 time: 0.156043 Jun 03 15:32:45.252238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 424/823] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:45 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:46.271076 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6e3bec1d-48e9-4d77-b6c9-1783e73d9b9d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:46.272398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6e3bec1d-48e9-4d77-b6c9-1783e73d9b9d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:46.280070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6e3bec1d-48e9-4d77-b6c9-1783e73d9b9d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:46.280532 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6e3bec1d-48e9-4d77-b6c9-1783e73d9b9d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:46.281309 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6e3bec1d-48e9-4d77-b6c9-1783e73d9b9d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:46.281917 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6e3bec1d-48e9-4d77-b6c9-1783e73d9b9d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:46.422961 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6e3bec1d-48e9-4d77-b6c9-1783e73d9b9d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:46.430952 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6e3bec1d-48e9-4d77-b6c9-1783e73d9b9d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:46.432756 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6e3bec1d-48e9-4d77-b6c9-1783e73d9b9d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:46.433639 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6e3bec1d-48e9-4d77-b6c9-1783e73d9b9d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1721 microversion: 2.20 time: 0.167075 Jun 03 15:32:46.434202 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 400/824] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:46 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:47.452401 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4a598752-95cc-4709-ab25-24dc266a3e79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:47.453020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4a598752-95cc-4709-ab25-24dc266a3e79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:47.459222 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4a598752-95cc-4709-ab25-24dc266a3e79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:47.459678 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4a598752-95cc-4709-ab25-24dc266a3e79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:47.460454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4a598752-95cc-4709-ab25-24dc266a3e79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:47.460887 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4a598752-95cc-4709-ab25-24dc266a3e79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:47.595166 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4a598752-95cc-4709-ab25-24dc266a3e79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:47.603762 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4a598752-95cc-4709-ab25-24dc266a3e79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:47.605387 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4a598752-95cc-4709-ab25-24dc266a3e79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:47.607367 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4a598752-95cc-4709-ab25-24dc266a3e79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1721 microversion: 2.20 time: 0.158741 Jun 03 15:32:47.607841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 425/825] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:47 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:48.365993 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-2f772eb9-e525-44af-ab8a-2fc174463a1f req-d8a03308-228b-427b-b05d-e90604cebe8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43beed7e-5952-4cc8-89ea-8c819ceb44de", "name": "network-vif-unplugged", "status": "completed", "tag": "009f1a65-b949-4493-a4fc-88ecafb96c71"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:48.375542 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-2f772eb9-e525-44af-ab8a-2fc174463a1f req-d8a03308-228b-427b-b05d-e90604cebe8b service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:48.376277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-2f772eb9-e525-44af-ab8a-2fc174463a1f req-d8a03308-228b-427b-b05d-e90604cebe8b service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:48.389018 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.compute.server_external_events [req-2f772eb9-e525-44af-ab8a-2fc174463a1f req-d8a03308-228b-427b-b05d-e90604cebe8b service nova] Unable to find a host for instance 43beed7e-5952-4cc8-89ea-8c819ceb44de. Dropping event network-vif-unplugged {{(pid=117805) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 15:32:48.389912 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-2f772eb9-e525-44af-ab8a-2fc174463a1f req-d8a03308-228b-427b-b05d-e90604cebe8b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028673 Jun 03 15:32:48.391026 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 401/826] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 03 15:32:48.626686 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8f003ba2-0b7b-4658-8d0e-73cdb9b9935c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:48.627299 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8f003ba2-0b7b-4658-8d0e-73cdb9b9935c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:48.633735 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f003ba2-0b7b-4658-8d0e-73cdb9b9935c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:48.634186 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f003ba2-0b7b-4658-8d0e-73cdb9b9935c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:48.634987 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f003ba2-0b7b-4658-8d0e-73cdb9b9935c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:48.635428 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f003ba2-0b7b-4658-8d0e-73cdb9b9935c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:48.771016 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8f003ba2-0b7b-4658-8d0e-73cdb9b9935c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:48.780267 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8f003ba2-0b7b-4658-8d0e-73cdb9b9935c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:48.781777 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8f003ba2-0b7b-4658-8d0e-73cdb9b9935c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:48.782957 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8f003ba2-0b7b-4658-8d0e-73cdb9b9935c tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1664 microversion: 2.20 time: 0.160927 Jun 03 15:32:48.783523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 426/827] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:48 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:48.800980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e36717e0-a3f5-4130-ab3f-cf7d8595ae2a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92e87b64-7b99-4d9b-b705-eda7225560f8"}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:48.802070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e36717e0-a3f5-4130-ab3f-cf7d8595ae2a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:48.808121 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e36717e0-a3f5-4130-ab3f-cf7d8595ae2a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:48.808663 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e36717e0-a3f5-4130-ab3f-cf7d8595ae2a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:48.809997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e36717e0-a3f5-4130-ab3f-cf7d8595ae2a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:48.810431 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e36717e0-a3f5-4130-ab3f-cf7d8595ae2a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:48.978351 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:49.084858 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e36717e0-a3f5-4130-ab3f-cf7d8595ae2a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "POST /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287918 Jun 03 15:32:49.085477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 402/828] 10.222.0.93 () {62 vars in 1363 bytes} [Fri Jun 3 15:32:48 2022] POST /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 15:32:49.198178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4b91a20f-a23c-4a0e-9f7f-05217ce55dcd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:49.198713 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4b91a20f-a23c-4a0e-9f7f-05217ce55dcd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:49.205369 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4b91a20f-a23c-4a0e-9f7f-05217ce55dcd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:49.205824 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4b91a20f-a23c-4a0e-9f7f-05217ce55dcd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:49.206622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4b91a20f-a23c-4a0e-9f7f-05217ce55dcd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:49.207066 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4b91a20f-a23c-4a0e-9f7f-05217ce55dcd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:49.427949 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4b91a20f-a23c-4a0e-9f7f-05217ce55dcd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "DELETE /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/os-volume_attachments/92e87b64-7b99-4d9b-b705-eda7225560f8" status: 202 len: 0 microversion: 2.20 time: 0.233649 Jun 03 15:32:49.428572 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 427/829] 10.222.0.93 () {60 vars in 1456 bytes} [Fri Jun 3 15:32:49 2022] DELETE /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/os-volume_attachments/92e87b64-7b99-4d9b-b705-eda7225560f8 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:32:49.484018 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c708c5d5-eb1b-47ee-b0aa-11f6d6766971 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:32:49.484610 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c708c5d5-eb1b-47ee-b0aa-11f6d6766971 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:49.491881 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c708c5d5-eb1b-47ee-b0aa-11f6d6766971 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:49.492277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c708c5d5-eb1b-47ee-b0aa-11f6d6766971 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:49.493048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c708c5d5-eb1b-47ee-b0aa-11f6d6766971 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:49.493494 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c708c5d5-eb1b-47ee-b0aa-11f6d6766971 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:49.571456 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c708c5d5-eb1b-47ee-b0aa-11f6d6766971 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "POST /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/action" status: 202 len: 0 microversion: 2.20 time: 0.091306 Jun 03 15:32:49.572066 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 403/830] 10.222.0.93 () {62 vars in 1318 bytes} [Fri Jun 3 15:32:49 2022] POST /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:32:49.580690 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2238d0d7-77ce-4998-ba62-6515f9f26aba tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:49.581546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2238d0d7-77ce-4998-ba62-6515f9f26aba tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:49.587933 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2238d0d7-77ce-4998-ba62-6515f9f26aba tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:49.588385 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2238d0d7-77ce-4998-ba62-6515f9f26aba tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:49.589337 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2238d0d7-77ce-4998-ba62-6515f9f26aba tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:49.589940 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2238d0d7-77ce-4998-ba62-6515f9f26aba tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:49.745367 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2238d0d7-77ce-4998-ba62-6515f9f26aba tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:49.755823 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2238d0d7-77ce-4998-ba62-6515f9f26aba tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:49.757547 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2238d0d7-77ce-4998-ba62-6515f9f26aba tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:49.758849 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2238d0d7-77ce-4998-ba62-6515f9f26aba tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1672 microversion: 2.20 time: 0.182073 Jun 03 15:32:49.759344 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 428/831] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:49 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:32:50.778837 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5d48dfbb-5f83-4088-94d7-62416a2399cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:50.779611 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5d48dfbb-5f83-4088-94d7-62416a2399cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:50.789398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5d48dfbb-5f83-4088-94d7-62416a2399cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:50.789853 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5d48dfbb-5f83-4088-94d7-62416a2399cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:50.790655 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5d48dfbb-5f83-4088-94d7-62416a2399cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:50.791095 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5d48dfbb-5f83-4088-94d7-62416a2399cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:50.993655 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5d48dfbb-5f83-4088-94d7-62416a2399cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:51.002122 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5d48dfbb-5f83-4088-94d7-62416a2399cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:51.003715 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5d48dfbb-5f83-4088-94d7-62416a2399cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:51.004873 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5d48dfbb-5f83-4088-94d7-62416a2399cf tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.230675 Jun 03 15:32:51.005458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 404/832] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:50 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:52.029911 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1a87ab38-473f-447d-812a-718e27c47fea tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:52.031475 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1a87ab38-473f-447d-812a-718e27c47fea tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:52.046682 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=40 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:52.049692 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1a87ab38-473f-447d-812a-718e27c47fea tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:52.050692 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1a87ab38-473f-447d-812a-718e27c47fea tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:52.051914 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1a87ab38-473f-447d-812a-718e27c47fea tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:52.053086 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1a87ab38-473f-447d-812a-718e27c47fea tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:52.220804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1a87ab38-473f-447d-812a-718e27c47fea tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:52.230877 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1a87ab38-473f-447d-812a-718e27c47fea tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:52.233406 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1a87ab38-473f-447d-812a-718e27c47fea tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:52.234910 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1a87ab38-473f-447d-812a-718e27c47fea tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.213691 Jun 03 15:32:52.236010 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 429/833] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:52 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:53.253826 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f4db038e-0112-47f4-be8e-abb4d00a3628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:53.255089 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f4db038e-0112-47f4-be8e-abb4d00a3628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:53.261473 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f4db038e-0112-47f4-be8e-abb4d00a3628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:53.261935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f4db038e-0112-47f4-be8e-abb4d00a3628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:53.263501 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f4db038e-0112-47f4-be8e-abb4d00a3628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:53.263936 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f4db038e-0112-47f4-be8e-abb4d00a3628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:53.406848 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f4db038e-0112-47f4-be8e-abb4d00a3628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:53.415357 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f4db038e-0112-47f4-be8e-abb4d00a3628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:53.416879 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f4db038e-0112-47f4-be8e-abb4d00a3628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:53.418550 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f4db038e-0112-47f4-be8e-abb4d00a3628 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.168503 Jun 03 15:32:53.419688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 405/834] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:53 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:54.437717 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-06edbfe7-3ed3-4d11-ae6e-e7078c3e89ff tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:54.438328 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-06edbfe7-3ed3-4d11-ae6e-e7078c3e89ff tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:54.445067 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06edbfe7-3ed3-4d11-ae6e-e7078c3e89ff tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:54.445520 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06edbfe7-3ed3-4d11-ae6e-e7078c3e89ff tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:54.446291 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06edbfe7-3ed3-4d11-ae6e-e7078c3e89ff tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:54.446768 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06edbfe7-3ed3-4d11-ae6e-e7078c3e89ff tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:54.580265 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-06edbfe7-3ed3-4d11-ae6e-e7078c3e89ff tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:54.588402 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-06edbfe7-3ed3-4d11-ae6e-e7078c3e89ff tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:54.589924 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-06edbfe7-3ed3-4d11-ae6e-e7078c3e89ff tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:54.591192 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-06edbfe7-3ed3-4d11-ae6e-e7078c3e89ff tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.157880 Jun 03 15:32:54.592022 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 430/835] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:54 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:55.609800 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-98ddb9bd-3236-4196-928c-89ff666abfd8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:55.610708 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-98ddb9bd-3236-4196-928c-89ff666abfd8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:55.618030 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98ddb9bd-3236-4196-928c-89ff666abfd8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:55.618628 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98ddb9bd-3236-4196-928c-89ff666abfd8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:55.619779 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98ddb9bd-3236-4196-928c-89ff666abfd8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:55.620280 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98ddb9bd-3236-4196-928c-89ff666abfd8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:55.759764 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-98ddb9bd-3236-4196-928c-89ff666abfd8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:55.768870 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-98ddb9bd-3236-4196-928c-89ff666abfd8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:55.770386 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-98ddb9bd-3236-4196-928c-89ff666abfd8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:55.771630 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-98ddb9bd-3236-4196-928c-89ff666abfd8 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.166430 Jun 03 15:32:55.772397 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 406/836] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:55 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:56.791015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d28eb7e8-0c95-4a1f-bbce-afdb1a5d0171 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:56.791639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d28eb7e8-0c95-4a1f-bbce-afdb1a5d0171 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:56.799461 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d28eb7e8-0c95-4a1f-bbce-afdb1a5d0171 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:56.799840 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d28eb7e8-0c95-4a1f-bbce-afdb1a5d0171 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:56.800777 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d28eb7e8-0c95-4a1f-bbce-afdb1a5d0171 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:56.801220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d28eb7e8-0c95-4a1f-bbce-afdb1a5d0171 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:56.950043 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d28eb7e8-0c95-4a1f-bbce-afdb1a5d0171 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:56.953646 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:32:56.959339 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d28eb7e8-0c95-4a1f-bbce-afdb1a5d0171 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:56.960844 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d28eb7e8-0c95-4a1f-bbce-afdb1a5d0171 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:56.962027 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d28eb7e8-0c95-4a1f-bbce-afdb1a5d0171 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.175388 Jun 03 15:32:56.962804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 431/837] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:56 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:57.981578 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-285a5b58-d045-4a4f-b237-b432aefc9941 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:57.982207 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-285a5b58-d045-4a4f-b237-b432aefc9941 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:57.988889 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-285a5b58-d045-4a4f-b237-b432aefc9941 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:57.989342 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-285a5b58-d045-4a4f-b237-b432aefc9941 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:57.990119 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-285a5b58-d045-4a4f-b237-b432aefc9941 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:57.990599 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-285a5b58-d045-4a4f-b237-b432aefc9941 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:58.132269 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-285a5b58-d045-4a4f-b237-b432aefc9941 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:58.143225 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-285a5b58-d045-4a4f-b237-b432aefc9941 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:58.144734 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-285a5b58-d045-4a4f-b237-b432aefc9941 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:58.146085 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-285a5b58-d045-4a4f-b237-b432aefc9941 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.169688 Jun 03 15:32:58.147019 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 407/838] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:57 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:32:59.166626 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2bba9858-41ec-44b6-a6be-73d80abe5665 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:32:59.167318 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2bba9858-41ec-44b6-a6be-73d80abe5665 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:32:59.174232 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2bba9858-41ec-44b6-a6be-73d80abe5665 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:59.174708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2bba9858-41ec-44b6-a6be-73d80abe5665 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:59.175480 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2bba9858-41ec-44b6-a6be-73d80abe5665 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:32:59.175910 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2bba9858-41ec-44b6-a6be-73d80abe5665 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:32:59.317628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2bba9858-41ec-44b6-a6be-73d80abe5665 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:59.328595 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2bba9858-41ec-44b6-a6be-73d80abe5665 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:59.330094 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2bba9858-41ec-44b6-a6be-73d80abe5665 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:32:59.331312 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2bba9858-41ec-44b6-a6be-73d80abe5665 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.170978 Jun 03 15:32:59.332050 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 432/839] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:32:59 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:00.351012 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e01c4418-607c-4490-8b49-428368dd9ca4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:00.351765 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e01c4418-607c-4490-8b49-428368dd9ca4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:00.360266 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e01c4418-607c-4490-8b49-428368dd9ca4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:00.360712 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e01c4418-607c-4490-8b49-428368dd9ca4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:00.361499 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e01c4418-607c-4490-8b49-428368dd9ca4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:00.361940 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e01c4418-607c-4490-8b49-428368dd9ca4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:00.499600 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e01c4418-607c-4490-8b49-428368dd9ca4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:00.508987 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e01c4418-607c-4490-8b49-428368dd9ca4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:00.511014 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e01c4418-607c-4490-8b49-428368dd9ca4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:00.513091 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e01c4418-607c-4490-8b49-428368dd9ca4 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.165912 Jun 03 15:33:00.525206 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 408/840] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:00 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:01.543443 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f1d58fe4-8cba-4178-8e27-dab9ea21714a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:01.545059 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f1d58fe4-8cba-4178-8e27-dab9ea21714a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:01.561664 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f1d58fe4-8cba-4178-8e27-dab9ea21714a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:01.562217 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f1d58fe4-8cba-4178-8e27-dab9ea21714a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:01.563113 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f1d58fe4-8cba-4178-8e27-dab9ea21714a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:01.563848 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f1d58fe4-8cba-4178-8e27-dab9ea21714a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:01.763249 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f1d58fe4-8cba-4178-8e27-dab9ea21714a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:01.773921 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f1d58fe4-8cba-4178-8e27-dab9ea21714a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:01.775681 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f1d58fe4-8cba-4178-8e27-dab9ea21714a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:01.778518 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f1d58fe4-8cba-4178-8e27-dab9ea21714a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.243648 Jun 03 15:33:01.779308 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 433/841] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:01 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:02.798062 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-96f95d93-1c52-4fae-a4e5-331ade31885e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:02.798684 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-96f95d93-1c52-4fae-a4e5-331ade31885e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:02.805256 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-96f95d93-1c52-4fae-a4e5-331ade31885e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:02.805700 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-96f95d93-1c52-4fae-a4e5-331ade31885e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:02.806484 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-96f95d93-1c52-4fae-a4e5-331ade31885e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:02.806959 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-96f95d93-1c52-4fae-a4e5-331ade31885e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:02.938944 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-96f95d93-1c52-4fae-a4e5-331ade31885e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:02.947041 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-96f95d93-1c52-4fae-a4e5-331ade31885e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:02.948588 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-96f95d93-1c52-4fae-a4e5-331ade31885e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:02.950249 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-96f95d93-1c52-4fae-a4e5-331ade31885e tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.155851 Jun 03 15:33:02.950872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 409/842] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:02 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:03.968822 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8805ad7f-de76-4ab2-9165-c761b1576913 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:03.969452 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8805ad7f-de76-4ab2-9165-c761b1576913 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:03.976109 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8805ad7f-de76-4ab2-9165-c761b1576913 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:03.976575 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8805ad7f-de76-4ab2-9165-c761b1576913 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:03.977347 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8805ad7f-de76-4ab2-9165-c761b1576913 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:03.977822 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8805ad7f-de76-4ab2-9165-c761b1576913 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:04.120964 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8805ad7f-de76-4ab2-9165-c761b1576913 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:04.128893 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8805ad7f-de76-4ab2-9165-c761b1576913 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:04.130395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8805ad7f-de76-4ab2-9165-c761b1576913 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:04.131584 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8805ad7f-de76-4ab2-9165-c761b1576913 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.167283 Jun 03 15:33:04.132152 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 434/843] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:03 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:05.150424 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6776f9c3-6d5d-4678-9829-4f5b8e57bba6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:05.151082 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6776f9c3-6d5d-4678-9829-4f5b8e57bba6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:05.157598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6776f9c3-6d5d-4678-9829-4f5b8e57bba6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:05.158071 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6776f9c3-6d5d-4678-9829-4f5b8e57bba6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:05.158997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6776f9c3-6d5d-4678-9829-4f5b8e57bba6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:05.159593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6776f9c3-6d5d-4678-9829-4f5b8e57bba6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:05.298925 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6776f9c3-6d5d-4678-9829-4f5b8e57bba6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:05.306897 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6776f9c3-6d5d-4678-9829-4f5b8e57bba6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:05.308414 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6776f9c3-6d5d-4678-9829-4f5b8e57bba6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:05.309570 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6776f9c3-6d5d-4678-9829-4f5b8e57bba6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.163195 Jun 03 15:33:05.310122 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 410/844] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:05 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 15:33:06.328250 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e78f7bb2-659b-48c6-8990-21a97122e189 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:06.328857 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e78f7bb2-659b-48c6-8990-21a97122e189 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:06.335406 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e78f7bb2-659b-48c6-8990-21a97122e189 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:06.335881 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e78f7bb2-659b-48c6-8990-21a97122e189 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:06.336638 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e78f7bb2-659b-48c6-8990-21a97122e189 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:06.337067 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e78f7bb2-659b-48c6-8990-21a97122e189 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:06.471080 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e78f7bb2-659b-48c6-8990-21a97122e189 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:06.474006 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-68689b52-5c42-423e-9055-62a091bae2f9 req-02f41762-c48e-42ed-bfaf-57a7e2c9c6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43beed7e-5952-4cc8-89ea-8c819ceb44de", "name": "network-vif-plugged", "status": "completed", "tag": "009f1a65-b949-4493-a4fc-88ecafb96c71"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:06.482428 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e78f7bb2-659b-48c6-8990-21a97122e189 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:06.484573 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e78f7bb2-659b-48c6-8990-21a97122e189 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:06.486106 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-68689b52-5c42-423e-9055-62a091bae2f9 req-02f41762-c48e-42ed-bfaf-57a7e2c9c6d3 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:06.486301 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e78f7bb2-659b-48c6-8990-21a97122e189 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.161645 Jun 03 15:33:06.486567 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-68689b52-5c42-423e-9055-62a091bae2f9 req-02f41762-c48e-42ed-bfaf-57a7e2c9c6d3 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:06.486817 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 435/845] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:06 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:06.511697 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-68689b52-5c42-423e-9055-62a091bae2f9 req-02f41762-c48e-42ed-bfaf-57a7e2c9c6d3 service nova] Creating event network-vif-plugged:009f1a65-b949-4493-a4fc-88ecafb96c71 for instance 43beed7e-5952-4cc8-89ea-8c819ceb44de on hv-cinder-83124 Jun 03 15:33:06.517608 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-68689b52-5c42-423e-9055-62a091bae2f9 req-02f41762-c48e-42ed-bfaf-57a7e2c9c6d3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048602 Jun 03 15:33:06.518367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 411/846] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:07.505436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c81aa2da-6ac9-4371-a8ed-4294cafb1a79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:07.506348 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c81aa2da-6ac9-4371-a8ed-4294cafb1a79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:07.513134 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c81aa2da-6ac9-4371-a8ed-4294cafb1a79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:07.513574 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c81aa2da-6ac9-4371-a8ed-4294cafb1a79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:07.514334 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c81aa2da-6ac9-4371-a8ed-4294cafb1a79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:07.514799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c81aa2da-6ac9-4371-a8ed-4294cafb1a79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:07.651894 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c81aa2da-6ac9-4371-a8ed-4294cafb1a79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:07.661472 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c81aa2da-6ac9-4371-a8ed-4294cafb1a79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:07.663034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c81aa2da-6ac9-4371-a8ed-4294cafb1a79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:07.664202 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c81aa2da-6ac9-4371-a8ed-4294cafb1a79 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.162647 Jun 03 15:33:07.664761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 436/847] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:07 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:08.683891 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2e2d2f16-1227-42b4-8942-7aa95ca41df7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:08.684591 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2e2d2f16-1227-42b4-8942-7aa95ca41df7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:08.691902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2e2d2f16-1227-42b4-8942-7aa95ca41df7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:08.692355 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2e2d2f16-1227-42b4-8942-7aa95ca41df7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:08.693124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2e2d2f16-1227-42b4-8942-7aa95ca41df7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:08.693565 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2e2d2f16-1227-42b4-8942-7aa95ca41df7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:08.841350 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2e2d2f16-1227-42b4-8942-7aa95ca41df7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:08.850410 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2e2d2f16-1227-42b4-8942-7aa95ca41df7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:08.852321 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2e2d2f16-1227-42b4-8942-7aa95ca41df7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:08.854330 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2e2d2f16-1227-42b4-8942-7aa95ca41df7 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1730 microversion: 2.20 time: 0.174726 Jun 03 15:33:08.854619 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 412/848] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:08 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:09.872494 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ceae9ffe-a29f-49b2-85c4-97183c2725c5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:09.873096 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ceae9ffe-a29f-49b2-85c4-97183c2725c5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:09.880212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ceae9ffe-a29f-49b2-85c4-97183c2725c5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:09.880662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ceae9ffe-a29f-49b2-85c4-97183c2725c5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:09.881425 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ceae9ffe-a29f-49b2-85c4-97183c2725c5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:09.881858 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ceae9ffe-a29f-49b2-85c4-97183c2725c5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:10.015624 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ceae9ffe-a29f-49b2-85c4-97183c2725c5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:10.023449 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ceae9ffe-a29f-49b2-85c4-97183c2725c5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:10.024944 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ceae9ffe-a29f-49b2-85c4-97183c2725c5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:10.026492 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ceae9ffe-a29f-49b2-85c4-97183c2725c5 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1717 microversion: 2.20 time: 0.157980 Jun 03 15:33:10.027490 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 437/849] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:09 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:13.431501 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-23690656-3149-45e2-9080-5e3bffa1d6f9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:13.432103 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-23690656-3149-45e2-9080-5e3bffa1d6f9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:13.434693 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=32 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:13.440869 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-23690656-3149-45e2-9080-5e3bffa1d6f9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:13.441319 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-23690656-3149-45e2-9080-5e3bffa1d6f9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:13.442094 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-23690656-3149-45e2-9080-5e3bffa1d6f9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:13.442557 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-23690656-3149-45e2-9080-5e3bffa1d6f9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:13.465141 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-23690656-3149-45e2-9080-5e3bffa1d6f9 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/ips" status: 200 len: 149 microversion: 2.1 time: 0.037805 Jun 03 15:33:13.465706 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 413/850] 10.222.0.93 () {58 vars in 1247 bytes} [Fri Jun 3 15:33:13 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:14.787280 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a5eebf3f-3bd9-466f-9e73-205c16be0539 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f31877b7-1746-402f-8d87-c213514a58e3"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:14.788704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a5eebf3f-3bd9-466f-9e73-205c16be0539 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:14.796156 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a5eebf3f-3bd9-466f-9e73-205c16be0539 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:14.797170 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a5eebf3f-3bd9-466f-9e73-205c16be0539 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:14.798026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a5eebf3f-3bd9-466f-9e73-205c16be0539 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:14.798480 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a5eebf3f-3bd9-466f-9e73-205c16be0539 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:15.043275 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a5eebf3f-3bd9-466f-9e73-205c16be0539 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "POST /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260254 Jun 03 15:33:15.043914 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 438/851] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:33:14 2022] POST /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:17.047534 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-fe3bdfad-d8ab-42e2-808d-e4196306d5e8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:17.048100 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-fe3bdfad-d8ab-42e2-808d-e4196306d5e8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:17.054680 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe3bdfad-d8ab-42e2-808d-e4196306d5e8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:17.055126 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe3bdfad-d8ab-42e2-808d-e4196306d5e8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:17.055976 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe3bdfad-d8ab-42e2-808d-e4196306d5e8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:17.056983 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-fe3bdfad-d8ab-42e2-808d-e4196306d5e8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:17.080546 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-fe3bdfad-d8ab-42e2-808d-e4196306d5e8 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/ips" status: 200 len: 146 microversion: 2.1 time: 0.036843 Jun 03 15:33:17.081398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 414/852] 10.222.0.93 () {58 vars in 1247 bytes} [Fri Jun 3 15:33:17 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:18.407502 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-da9abee5-e517-4aad-8e81-c357cb45b8c4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "290e6e67-ef27-413b-95c8-30447b33eca6"}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:18.408702 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-da9abee5-e517-4aad-8e81-c357cb45b8c4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:18.415077 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-da9abee5-e517-4aad-8e81-c357cb45b8c4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:18.415687 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-da9abee5-e517-4aad-8e81-c357cb45b8c4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:18.416477 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-da9abee5-e517-4aad-8e81-c357cb45b8c4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:18.416923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-da9abee5-e517-4aad-8e81-c357cb45b8c4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:18.659254 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-da9abee5-e517-4aad-8e81-c357cb45b8c4 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256882 Jun 03 15:33:18.659859 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 439/853] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:33:18 2022] POST /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:22.648520 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-eb9a8e47-c03e-49a1-a3c3-8cef2c3f215d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:22.649137 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-eb9a8e47-c03e-49a1-a3c3-8cef2c3f215d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:22.655032 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb9a8e47-c03e-49a1-a3c3-8cef2c3f215d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:22.655584 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb9a8e47-c03e-49a1-a3c3-8cef2c3f215d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:22.656507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb9a8e47-c03e-49a1-a3c3-8cef2c3f215d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:22.657113 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eb9a8e47-c03e-49a1-a3c3-8cef2c3f215d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:22.659752 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:22.738231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-eb9a8e47-c03e-49a1-a3c3-8cef2c3f215d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lazy-loading 'services' on Instance uuid 4f911eff-09ff-4dd0-8c61-7798cc9ad53f {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:33:22.810692 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-eb9a8e47-c03e-49a1-a3c3-8cef2c3f215d tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments/f31877b7-1746-402f-8d87-c213514a58e3" status: 202 len: 0 microversion: 2.1 time: 0.166189 Jun 03 15:33:22.811300 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 415/854] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:33:22 2022] DELETE /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments/f31877b7-1746-402f-8d87-c213514a58e3 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:33:22.822610 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8cc52954-826a-4fb8-b7ff-da0612166d2a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:22.823640 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8cc52954-826a-4fb8-b7ff-da0612166d2a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:22.827048 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=22 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:22.835808 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8cc52954-826a-4fb8-b7ff-da0612166d2a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:22.836341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8cc52954-826a-4fb8-b7ff-da0612166d2a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:22.837128 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8cc52954-826a-4fb8-b7ff-da0612166d2a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:22.837577 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8cc52954-826a-4fb8-b7ff-da0612166d2a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:22.867660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8cc52954-826a-4fb8-b7ff-da0612166d2a tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049417 Jun 03 15:33:22.868509 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 440/855] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:22 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:23.880245 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-dc246d77-3979-4fb2-b6d4-0fcf58cc1775 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:23.881316 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-dc246d77-3979-4fb2-b6d4-0fcf58cc1775 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:23.888563 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc246d77-3979-4fb2-b6d4-0fcf58cc1775 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:23.889019 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc246d77-3979-4fb2-b6d4-0fcf58cc1775 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:23.890336 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc246d77-3979-4fb2-b6d4-0fcf58cc1775 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:23.890802 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-dc246d77-3979-4fb2-b6d4-0fcf58cc1775 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:23.922100 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-dc246d77-3979-4fb2-b6d4-0fcf58cc1775 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046746 Jun 03 15:33:23.922701 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 416/856] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:23 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:24.933574 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-849fa348-9243-4c43-8748-6612c15b7ae7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:24.934407 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-849fa348-9243-4c43-8748-6612c15b7ae7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:24.941469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-849fa348-9243-4c43-8748-6612c15b7ae7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:24.941913 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-849fa348-9243-4c43-8748-6612c15b7ae7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:24.942710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-849fa348-9243-4c43-8748-6612c15b7ae7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:24.943141 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-849fa348-9243-4c43-8748-6612c15b7ae7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:24.974020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-849fa348-9243-4c43-8748-6612c15b7ae7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044535 Jun 03 15:33:24.974614 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 441/857] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:24 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:25.986387 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-da4adfb6-e0e6-4291-a944-927cf75c5a7c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:25.987250 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-da4adfb6-e0e6-4291-a944-927cf75c5a7c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:25.994126 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-da4adfb6-e0e6-4291-a944-927cf75c5a7c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:25.994598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-da4adfb6-e0e6-4291-a944-927cf75c5a7c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:25.995366 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-da4adfb6-e0e6-4291-a944-927cf75c5a7c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:25.995797 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-da4adfb6-e0e6-4291-a944-927cf75c5a7c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:26.025387 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-da4adfb6-e0e6-4291-a944-927cf75c5a7c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Jun 03 15:33:26.026119 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 417/858] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:25 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:27.037795 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e03e9460-b51c-4b5c-8d8a-d670658679b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:27.038775 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e03e9460-b51c-4b5c-8d8a-d670658679b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:27.045742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e03e9460-b51c-4b5c-8d8a-d670658679b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:27.046198 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e03e9460-b51c-4b5c-8d8a-d670658679b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:27.047007 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e03e9460-b51c-4b5c-8d8a-d670658679b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:27.047471 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e03e9460-b51c-4b5c-8d8a-d670658679b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:27.079419 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e03e9460-b51c-4b5c-8d8a-d670658679b0 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045592 Jun 03 15:33:27.083567 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 442/859] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:27 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:28.090452 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e511d0e9-6f23-4f3d-a64e-4d72c2b35a72 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:28.091498 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e511d0e9-6f23-4f3d-a64e-4d72c2b35a72 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:28.098683 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e511d0e9-6f23-4f3d-a64e-4d72c2b35a72 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:28.099208 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e511d0e9-6f23-4f3d-a64e-4d72c2b35a72 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:28.100057 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e511d0e9-6f23-4f3d-a64e-4d72c2b35a72 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:28.100485 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e511d0e9-6f23-4f3d-a64e-4d72c2b35a72 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:28.132541 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e511d0e9-6f23-4f3d-a64e-4d72c2b35a72 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045981 Jun 03 15:33:28.133110 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 418/860] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:28 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:29.145657 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0f6bbd46-55d8-4d8f-88aa-ed5b0ce4b7b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:29.146505 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0f6bbd46-55d8-4d8f-88aa-ed5b0ce4b7b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:29.153225 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0f6bbd46-55d8-4d8f-88aa-ed5b0ce4b7b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:29.153662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0f6bbd46-55d8-4d8f-88aa-ed5b0ce4b7b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:29.154421 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0f6bbd46-55d8-4d8f-88aa-ed5b0ce4b7b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:29.154872 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0f6bbd46-55d8-4d8f-88aa-ed5b0ce4b7b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:29.180989 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:29.185649 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0f6bbd46-55d8-4d8f-88aa-ed5b0ce4b7b7 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044099 Jun 03 15:33:29.186211 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 443/861] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:29 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 15:33:29.244994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-28042028-f79b-48df-84ac-9d768534d510 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:29.245541 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-28042028-f79b-48df-84ac-9d768534d510 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:29.251975 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-28042028-f79b-48df-84ac-9d768534d510 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:29.252422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-28042028-f79b-48df-84ac-9d768534d510 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:29.253180 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-28042028-f79b-48df-84ac-9d768534d510 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:29.253612 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-28042028-f79b-48df-84ac-9d768534d510 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:29.279245 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-28042028-f79b-48df-84ac-9d768534d510 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:33:29.359737 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-28042028-f79b-48df-84ac-9d768534d510 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 204 len: 0 microversion: 2.1 time: 0.118290 Jun 03 15:33:29.361221 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 419/862] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:33:29 2022] DELETE /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:33:29.369323 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9c9eb819-4ec7-44b8-a776-fba66506ab1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:29.369931 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9c9eb819-4ec7-44b8-a776-fba66506ab1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:29.380175 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c9eb819-4ec7-44b8-a776-fba66506ab1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:29.380628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c9eb819-4ec7-44b8-a776-fba66506ab1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:29.381416 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c9eb819-4ec7-44b8-a776-fba66506ab1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:29.381855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c9eb819-4ec7-44b8-a776-fba66506ab1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:29.419129 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-35bad76d-090e-473c-8f54-0cee0c03d632 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:29.420141 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-35bad76d-090e-473c-8f54-0cee0c03d632 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:29.426186 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-35bad76d-090e-473c-8f54-0cee0c03d632 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:29.426896 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-35bad76d-090e-473c-8f54-0cee0c03d632 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:29.427668 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-35bad76d-090e-473c-8f54-0cee0c03d632 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:29.428102 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-35bad76d-090e-473c-8f54-0cee0c03d632 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:29.460766 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-35bad76d-090e-473c-8f54-0cee0c03d632 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Jun 03 15:33:29.461323 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 420/863] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:29 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:33:29.471490 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-010c3702-94c9-40f2-9b7f-a58354659e3c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:29.471977 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-010c3702-94c9-40f2-9b7f-a58354659e3c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:29.478100 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-010c3702-94c9-40f2-9b7f-a58354659e3c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:29.478553 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-010c3702-94c9-40f2-9b7f-a58354659e3c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:29.479364 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-010c3702-94c9-40f2-9b7f-a58354659e3c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:29.479836 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-010c3702-94c9-40f2-9b7f-a58354659e3c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:29.509140 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-010c3702-94c9-40f2-9b7f-a58354659e3c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments/290e6e67-ef27-413b-95c8-30447b33eca6" status: 200 len: 194 microversion: 2.1 time: 0.041631 Jun 03 15:33:29.509731 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 421/864] 10.222.0.93 () {58 vars in 1412 bytes} [Fri Jun 3 15:33:29 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments/290e6e67-ef27-413b-95c8-30447b33eca6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:33:29.521258 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9c9eb819-4ec7-44b8-a776-fba66506ab1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:29.529008 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9c9eb819-4ec7-44b8-a776-fba66506ab1c tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1682 microversion: 2.1 time: 0.163560 Jun 03 15:33:29.529604 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 444/865] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:29 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:30.065018 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1722608911", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "networks": [{"uuid": "914f3c40-3d58-42c5-84f2-1921af6d0fdf"}]}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:30.115684 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] validate_networks() for [('914f3c40-3d58-42c5-84f2-1921af6d0fdf', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:33:30.453417 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:33:30.454028 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:33:30.454316 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:33:30.454766 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:33:30.455186 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:33:30.463953 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:30.464408 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:30.465219 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:30.465661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:30.482991 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Getting quotas for project d5151421b3ee4477924cdab41025075b. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:33:30.486929 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Getting quotas for user 5b82f76d685041d084dd5f332a5b1105 and project d5151421b3ee4477924cdab41025075b. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:33:30.497983 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:33:30.500270 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:33:30.546268 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c1d23451-b115-447e-8cd7-c17f6f2cfe0d tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485625 Jun 03 15:33:30.546505 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5f1173d8-d55d-4cf4-8b10-ff8ae24a9dad tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:30.547026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5f1173d8-d55d-4cf4-8b10-ff8ae24a9dad tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:30.551911 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 422/866] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:33:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:33:30.554227 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5f1173d8-d55d-4cf4-8b10-ff8ae24a9dad tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:30.554732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5f1173d8-d55d-4cf4-8b10-ff8ae24a9dad tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:30.555513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5f1173d8-d55d-4cf4-8b10-ff8ae24a9dad tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:30.555953 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5f1173d8-d55d-4cf4-8b10-ff8ae24a9dad tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:30.556820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e3c4c676-d6a1-448c-8243-599bd2023ae0 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:30.557475 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e3c4c676-d6a1-448c-8243-599bd2023ae0 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:30.621084 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e3c4c676-d6a1-448c-8243-599bd2023ae0 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:30.629606 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e3c4c676-d6a1-448c-8243-599bd2023ae0 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1219 microversion: 2.1 time: 0.076576 Jun 03 15:33:30.630176 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 423/867] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:30 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:30.707450 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5f1173d8-d55d-4cf4-8b10-ff8ae24a9dad tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:30.718636 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5f1173d8-d55d-4cf4-8b10-ff8ae24a9dad tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1682 microversion: 2.1 time: 0.175625 Jun 03 15:33:30.719698 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 445/868] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:30 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:33:30.825359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c5b3a3fa-a778-4f29-8d32-5ac1a6eb0a72 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceed3827-4627-4e0f-953e-4ea967965c30"}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:30.828083 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c5b3a3fa-a778-4f29-8d32-5ac1a6eb0a72 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:30.834103 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c5b3a3fa-a778-4f29-8d32-5ac1a6eb0a72 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:30.834585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c5b3a3fa-a778-4f29-8d32-5ac1a6eb0a72 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:30.835367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c5b3a3fa-a778-4f29-8d32-5ac1a6eb0a72 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:30.835897 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c5b3a3fa-a778-4f29-8d32-5ac1a6eb0a72 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:31.194047 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c5b3a3fa-a778-4f29-8d32-5ac1a6eb0a72 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "POST /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372460 Jun 03 15:33:31.199189 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 424/869] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:33:30 2022] POST /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:31.646965 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-34852b03-5685-4903-9f83-9f6c642696cc tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:31.647770 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-34852b03-5685-4903-9f83-9f6c642696cc tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:31.657957 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-34852b03-5685-4903-9f83-9f6c642696cc tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:31.660582 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-34852b03-5685-4903-9f83-9f6c642696cc tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:31.661631 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-34852b03-5685-4903-9f83-9f6c642696cc tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:31.662437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-34852b03-5685-4903-9f83-9f6c642696cc tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:31.738342 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5942dd97-ed53-4050-bef2-70426b96d096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:31.739832 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5942dd97-ed53-4050-bef2-70426b96d096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:31.744853 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-34852b03-5685-4903-9f83-9f6c642696cc tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:31.751564 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5942dd97-ed53-4050-bef2-70426b96d096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:31.760050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5942dd97-ed53-4050-bef2-70426b96d096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:31.761514 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5942dd97-ed53-4050-bef2-70426b96d096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:31.762197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5942dd97-ed53-4050-bef2-70426b96d096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:31.772622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-34852b03-5685-4903-9f83-9f6c642696cc tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1279 microversion: 2.1 time: 0.128956 Jun 03 15:33:31.782800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 446/870] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:31 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:31.878825 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5942dd97-ed53-4050-bef2-70426b96d096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193a35a91a47410f8b12cb2e84b33e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f48e1939245eaa67bcd6a27bc7cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:31.887066 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5942dd97-ed53-4050-bef2-70426b96d096 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 200 len: 1614 microversion: 2.1 time: 0.153304 Jun 03 15:33:31.887906 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 425/871] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:31 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 1614 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:33:32.101513 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-d508341d-2276-4b08-a4fa-cae81ffb16ab req-0583f525-5441-494b-9484-ce11cca796b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f911eff-09ff-4dd0-8c61-7798cc9ad53f", "name": "network-vif-deleted", "tag": "b04e40b4-2410-4984-b7d1-f08887d6d894"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:32.117906 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-d508341d-2276-4b08-a4fa-cae81ffb16ab req-0583f525-5441-494b-9484-ce11cca796b6 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:32.118348 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-d508341d-2276-4b08-a4fa-cae81ffb16ab req-0583f525-5441-494b-9484-ce11cca796b6 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:32.131577 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-d508341d-2276-4b08-a4fa-cae81ffb16ab req-0583f525-5441-494b-9484-ce11cca796b6 service nova] Creating event network-vif-deleted:b04e40b4-2410-4984-b7d1-f08887d6d894 for instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f on hv-cinder-83124 Jun 03 15:33:32.139354 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-d508341d-2276-4b08-a4fa-cae81ffb16ab req-0583f525-5441-494b-9484-ce11cca796b6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041236 Jun 03 15:33:32.141318 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 447/872] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:32.790164 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-79b16d99-6f98-490a-83a7-b800d3384994 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:32.791707 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-79b16d99-6f98-490a-83a7-b800d3384994 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:32.798610 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-79b16d99-6f98-490a-83a7-b800d3384994 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:32.799376 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-79b16d99-6f98-490a-83a7-b800d3384994 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:32.800371 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-79b16d99-6f98-490a-83a7-b800d3384994 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:32.801013 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-79b16d99-6f98-490a-83a7-b800d3384994 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:32.906504 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f80bc712-72d2-43ba-86af-9109058fbb54 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:32.907951 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f80bc712-72d2-43ba-86af-9109058fbb54 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:32.915992 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f80bc712-72d2-43ba-86af-9109058fbb54 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:32.916806 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f80bc712-72d2-43ba-86af-9109058fbb54 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:32.917836 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f80bc712-72d2-43ba-86af-9109058fbb54 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:32.918499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f80bc712-72d2-43ba-86af-9109058fbb54 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:32.936371 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-f80bc712-72d2-43ba-86af-9109058fbb54 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f80bc712-72d2-43ba-86af-9109058fbb54 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f HTTP/1.1 Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:33:32.938305 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:32.939828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '4f911eff-09ff-4dd0-8c61-7798cc9ad53f'} Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:32.940616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:32.941928 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:32.946077 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f80bc712-72d2-43ba-86af-9109058fbb54 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:32.947433 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f80bc712-72d2-43ba-86af-9109058fbb54 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 404 len: 111 microversion: 2.1 time: 0.045539 Jun 03 15:33:32.948311 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 448/873] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:32 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:32.951155 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-79b16d99-6f98-490a-83a7-b800d3384994 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:32.957541 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d6e62f0b-911c-4725-9f8c-5bc83aa5b008 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '.version_select at 0x7f92f0da5d30>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:32.960369 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-79b16d99-6f98-490a-83a7-b800d3384994 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1319 microversion: 2.1 time: 0.173888 Jun 03 15:33:32.961948 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 426/874] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:32 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:32.986565 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d6e62f0b-911c-4725-9f8c-5bc83aa5b008 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016400701" status: 202 len: 0 microversion: 2.1 time: 0.032918 Jun 03 15:33:32.987121 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 449/875] 10.222.0.93 () {58 vars in 1220 bytes} [Fri Jun 3 15:33:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016400701 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 15:33:33.370632 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-07869e69-7864-4f2e-a01d-33c93a006f95 req-14a229a6-3f36-40af-80b7-c4c8f3ee4e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad1307c-04fc-4558-9d69-49236090c8b1", "tag": "53d986f2-9b7e-4d47-98b6-97e16d55aae9"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:33.398865 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-07869e69-7864-4f2e-a01d-33c93a006f95 req-14a229a6-3f36-40af-80b7-c4c8f3ee4e02 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:33.399405 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-07869e69-7864-4f2e-a01d-33c93a006f95 req-14a229a6-3f36-40af-80b7-c4c8f3ee4e02 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:33.412260 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-07869e69-7864-4f2e-a01d-33c93a006f95 req-14a229a6-3f36-40af-80b7-c4c8f3ee4e02 service nova] Creating event network-changed:53d986f2-9b7e-4d47-98b6-97e16d55aae9 for instance 6ad1307c-04fc-4558-9d69-49236090c8b1 on hv-cinder-83124 Jun 03 15:33:33.417199 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-07869e69-7864-4f2e-a01d-33c93a006f95 req-14a229a6-3f36-40af-80b7-c4c8f3ee4e02 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057129 Jun 03 15:33:33.417895 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 427/876] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:33.981771 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c613ea23-cb3a-461e-8b19-2a4afd489af8 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:33.981771 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c613ea23-cb3a-461e-8b19-2a4afd489af8 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:33.988821 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c613ea23-cb3a-461e-8b19-2a4afd489af8 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:33.989415 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c613ea23-cb3a-461e-8b19-2a4afd489af8 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:33.990480 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c613ea23-cb3a-461e-8b19-2a4afd489af8 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:33.991011 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c613ea23-cb3a-461e-8b19-2a4afd489af8 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:34.132869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c613ea23-cb3a-461e-8b19-2a4afd489af8 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:34.141397 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c613ea23-cb3a-461e-8b19-2a4afd489af8 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1319 microversion: 2.1 time: 0.166243 Jun 03 15:33:34.141958 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 450/877] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:33 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:35.116233 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-12ea8a0f-f2b2-4834-8690-5efe5107405e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:35.116812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-12ea8a0f-f2b2-4834-8690-5efe5107405e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:35.123421 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-12ea8a0f-f2b2-4834-8690-5efe5107405e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:35.124501 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-12ea8a0f-f2b2-4834-8690-5efe5107405e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:35.125264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-12ea8a0f-f2b2-4834-8690-5efe5107405e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:35.125697 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-12ea8a0f-f2b2-4834-8690-5efe5107405e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:35.138838 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-12ea8a0f-f2b2-4834-8690-5efe5107405e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-12ea8a0f-f2b2-4834-8690-5efe5107405e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: DELETE /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f HTTP/1.1 Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:33:35.140458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:35.142048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '4f911eff-09ff-4dd0-8c61-7798cc9ad53f'} Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:35.143124 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:35.144602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:35.146186 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-12ea8a0f-f2b2-4834-8690-5efe5107405e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:35.146186 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-12ea8a0f-f2b2-4834-8690-5efe5107405e tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 404 len: 111 microversion: 2.1 time: 0.030390 Jun 03 15:33:35.146186 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 428/878] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:33:35 2022] DELETE /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:35.150493 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-53298d3a-f921-4b73-93fe-d4f174e963c3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:35.151145 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-53298d3a-f921-4b73-93fe-d4f174e963c3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: 4f911eff-09ff-4dd0-8c61-7798cc9ad53f] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:35.157107 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9c172696-0df4-4eb1-8a55-41822eec4ba9 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:35.157713 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9c172696-0df4-4eb1-8a55-41822eec4ba9 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:35.157995 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-53298d3a-f921-4b73-93fe-d4f174e963c3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:35.158450 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-53298d3a-f921-4b73-93fe-d4f174e963c3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:35.159322 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-53298d3a-f921-4b73-93fe-d4f174e963c3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:35.159692 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-53298d3a-f921-4b73-93fe-d4f174e963c3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:35.164002 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9c172696-0df4-4eb1-8a55-41822eec4ba9 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:35.164745 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9c172696-0df4-4eb1-8a55-41822eec4ba9 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:35.166029 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9c172696-0df4-4eb1-8a55-41822eec4ba9 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:35.166493 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9c172696-0df4-4eb1-8a55-41822eec4ba9 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:35.176745 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-53298d3a-f921-4b73-93fe-d4f174e963c3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-53298d3a-f921-4b73-93fe-d4f174e963c3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f HTTP/1.1 Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:33:35.178310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:35.179895 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '4f911eff-09ff-4dd0-8c61-7798cc9ad53f'} Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:35.180841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. Jun 03 15:33:35.182294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:35.183973 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-53298d3a-f921-4b73-93fe-d4f174e963c3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance 4f911eff-09ff-4dd0-8c61-7798cc9ad53f could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:35.183973 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-53298d3a-f921-4b73-93fe-d4f174e963c3 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f" status: 404 len: 111 microversion: 2.1 time: 0.033354 Jun 03 15:33:35.183973 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 451/879] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:35 2022] GET /compute/v2.1/servers/4f911eff-09ff-4dd0-8c61-7798cc9ad53f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:35.318645 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9c172696-0df4-4eb1-8a55-41822eec4ba9 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:35.326354 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9c172696-0df4-4eb1-8a55-41822eec4ba9 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1319 microversion: 2.1 time: 0.173028 Jun 03 15:33:35.326953 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 429/880] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:35 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:33:36.321190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6744f08d-a619-4a94-9a3a-1b49a6ca6530 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:36.321692 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6744f08d-a619-4a94-9a3a-1b49a6ca6530 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:36.328775 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6744f08d-a619-4a94-9a3a-1b49a6ca6530 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:36.329247 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6744f08d-a619-4a94-9a3a-1b49a6ca6530 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:36.330002 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6744f08d-a619-4a94-9a3a-1b49a6ca6530 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:36.330442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6744f08d-a619-4a94-9a3a-1b49a6ca6530 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:36.343202 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9cb309b4-c5b6-4bd8-ba0a-d1cb95c28788 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:36.343740 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9cb309b4-c5b6-4bd8-ba0a-d1cb95c28788 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:36.344469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-6744f08d-a619-4a94-9a3a-1b49a6ca6530 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6744f08d-a619-4a94-9a3a-1b49a6ca6530 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: DELETE /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa HTTP/1.1 Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:33:36.346025 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:33:36.347500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'd49a8a8d-d24d-42e9-8a4d-775920a378aa'} Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:36.348372 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:33:36.349854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.351335 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6744f08d-a619-4a94-9a3a-1b49a6ca6530 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:36.351335 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6744f08d-a619-4a94-9a3a-1b49a6ca6530 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 404 len: 111 microversion: 2.1 time: 0.030182 Jun 03 15:33:36.351335 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 452/881] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:33:36 2022] DELETE /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:36.351878 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9cb309b4-c5b6-4bd8-ba0a-d1cb95c28788 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:36.351878 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9cb309b4-c5b6-4bd8-ba0a-d1cb95c28788 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:36.351878 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9cb309b4-c5b6-4bd8-ba0a-d1cb95c28788 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:36.352291 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9cb309b4-c5b6-4bd8-ba0a-d1cb95c28788 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:36.355622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-13c57401-c478-402f-b4b6-6cbdd94ed797 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:36.356241 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-13c57401-c478-402f-b4b6-6cbdd94ed797 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: d49a8a8d-d24d-42e9-8a4d-775920a378aa] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:36.362121 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-13c57401-c478-402f-b4b6-6cbdd94ed797 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:36.362621 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-13c57401-c478-402f-b4b6-6cbdd94ed797 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:36.363399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-13c57401-c478-402f-b4b6-6cbdd94ed797 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:36.363841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-13c57401-c478-402f-b4b6-6cbdd94ed797 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:36.377876 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-13c57401-c478-402f-b4b6-6cbdd94ed797 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-13c57401-c478-402f-b4b6-6cbdd94ed797 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa HTTP/1.1 Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:33:36.379438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:33:36.381015 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'd49a8a8d-d24d-42e9-8a4d-775920a378aa'} Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:36.381832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. Jun 03 15:33:36.383399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.384630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-13c57401-c478-402f-b4b6-6cbdd94ed797 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance d49a8a8d-d24d-42e9-8a4d-775920a378aa could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:36.384630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-13c57401-c478-402f-b4b6-6cbdd94ed797 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa" status: 404 len: 111 microversion: 2.1 time: 0.029019 Jun 03 15:33:36.384630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 453/882] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:36 2022] GET /compute/v2.1/servers/d49a8a8d-d24d-42e9-8a4d-775920a378aa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:33:36.389322 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-694a2880-03f8-4c4b-ba6e-e356d6cf88c8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:36.390468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-694a2880-03f8-4c4b-ba6e-e356d6cf88c8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:36.396540 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-694a2880-03f8-4c4b-ba6e-e356d6cf88c8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:36.397071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-694a2880-03f8-4c4b-ba6e-e356d6cf88c8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:36.397847 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-694a2880-03f8-4c4b-ba6e-e356d6cf88c8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:36.398285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-694a2880-03f8-4c4b-ba6e-e356d6cf88c8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:36.412064 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-694a2880-03f8-4c4b-ba6e-e356d6cf88c8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-694a2880-03f8-4c4b-ba6e-e356d6cf88c8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: DELETE /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 HTTP/1.1 Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:33:36.413630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:33:36.415732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2'} Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:36.416759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:33:36.418252 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.420224 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-694a2880-03f8-4c4b-ba6e-e356d6cf88c8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:36.420224 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-694a2880-03f8-4c4b-ba6e-e356d6cf88c8 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 404 len: 111 microversion: 2.1 time: 0.029980 Jun 03 15:33:36.420224 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 454/883] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:33:36 2022] DELETE /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:33:36.424067 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-64ef4006-1423-4040-9316-59a8c31cf5c1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:36.424614 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-64ef4006-1423-4040-9316-59a8c31cf5c1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:36.430677 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-64ef4006-1423-4040-9316-59a8c31cf5c1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:36.431127 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-64ef4006-1423-4040-9316-59a8c31cf5c1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:36.432112 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-64ef4006-1423-4040-9316-59a8c31cf5c1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:36.432510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-64ef4006-1423-4040-9316-59a8c31cf5c1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:36.447202 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-64ef4006-1423-4040-9316-59a8c31cf5c1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-64ef4006-1423-4040-9316-59a8c31cf5c1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 HTTP/1.1 Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:33:36.448744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:33:36.450331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2'} Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:36.451253 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. Jun 03 15:33:36.452841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:36.454396 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-64ef4006-1423-4040-9316-59a8c31cf5c1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:36.454396 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-64ef4006-1423-4040-9316-59a8c31cf5c1 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2" status: 404 len: 111 microversion: 2.1 time: 0.030229 Jun 03 15:33:36.454396 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 455/884] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:36 2022] GET /compute/v2.1/servers/fbacc2fb-8c4f-496f-97c4-97d1cbe1c9d2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:36.495776 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9cb309b4-c5b6-4bd8-ba0a-d1cb95c28788 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:36.504685 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9cb309b4-c5b6-4bd8-ba0a-d1cb95c28788 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1319 microversion: 2.1 time: 0.165210 Jun 03 15:33:36.505272 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 430/885] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:36 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:33:37.521310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-946131b3-24dd-42dd-bfac-2330636a0242 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:37.521905 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-946131b3-24dd-42dd-bfac-2330636a0242 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:37.528380 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-946131b3-24dd-42dd-bfac-2330636a0242 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:37.528833 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-946131b3-24dd-42dd-bfac-2330636a0242 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:37.529611 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-946131b3-24dd-42dd-bfac-2330636a0242 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:37.530820 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-946131b3-24dd-42dd-bfac-2330636a0242 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:37.607186 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b56ed043-0cad-4ea5-9aed-b90584bd9c47 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:37.608339 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b56ed043-0cad-4ea5-9aed-b90584bd9c47 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:37.615832 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b56ed043-0cad-4ea5-9aed-b90584bd9c47 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:37.616277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b56ed043-0cad-4ea5-9aed-b90584bd9c47 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:37.617258 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b56ed043-0cad-4ea5-9aed-b90584bd9c47 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:37.617814 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b56ed043-0cad-4ea5-9aed-b90584bd9c47 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:37.620818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:37.637716 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-b56ed043-0cad-4ea5-9aed-b90584bd9c47 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b56ed043-0cad-4ea5-9aed-b90584bd9c47 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: DELETE /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 HTTP/1.1 Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:33:37.640607 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:33:37.642264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': 'f9be206f-1554-46fe-9fa7-581d2d394865'} Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:37.643359 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:33:37.644824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:37.646597 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b56ed043-0cad-4ea5-9aed-b90584bd9c47 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:37.646597 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b56ed043-0cad-4ea5-9aed-b90584bd9c47 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 404 len: 111 microversion: 2.1 time: 0.039915 Jun 03 15:33:37.646597 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 431/886] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:33:37 2022] DELETE /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:33:37.655076 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-44619c01-8024-4511-ab73-6a29d080f557 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:37.655076 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-44619c01-8024-4511-ab73-6a29d080f557 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] [instance: f9be206f-1554-46fe-9fa7-581d2d394865] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:37.660236 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44619c01-8024-4511-ab73-6a29d080f557 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:37.660773 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44619c01-8024-4511-ab73-6a29d080f557 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:37.661786 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44619c01-8024-4511-ab73-6a29d080f557 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:37.662289 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44619c01-8024-4511-ab73-6a29d080f557 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:37.676426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-44619c01-8024-4511-ab73-6a29d080f557 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] HTTP exception thrown: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-44619c01-8024-4511-ab73-6a29d080f557 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Request method failure captured: Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 HTTP/1.1 Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimig6c0plghtoIH_0T9ReKnGWkOGYiNfQxDPLVznNi0XESPGEFO_r1GZHTCN3u5FQA91euwVzknnUDqJTVQFDQcnsRhZjRDmHkWL3i2Owvf-BKw3X3T-a4bUpjBsQTlv_oAzXTYq1-3JZWZhz13_jvZboQejx2Mb2WR_RoZ9dVKihiRU Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:33:37.678143 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e8f48e1939245eaa67bcd6a27bc7cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e8f48e1939245eaa67bcd6a27bc7cda"}]}] Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 3e8f48e1939245eaa67bcd6a27bc7cda Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1459823623 Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 193a35a91a47410f8b12cb2e84b33e1f Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeNegativeTest-1459823623-project Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:33:37.679807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': 'f9be206f-1554-46fe-9fa7-581d2d394865'} Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:37.680739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. Jun 03 15:33:37.682184 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:37.683537 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-44619c01-8024-4511-ab73-6a29d080f557 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] Returning 404 to user: Instance f9be206f-1554-46fe-9fa7-581d2d394865 could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:37.683537 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-44619c01-8024-4511-ab73-6a29d080f557 tempest-AttachVolumeNegativeTest-1459823623 tempest-AttachVolumeNegativeTest-1459823623-project] 10.222.0.93 "GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865" status: 404 len: 111 microversion: 2.1 time: 0.033674 Jun 03 15:33:37.683537 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 432/887] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:37 2022] GET /compute/v2.1/servers/f9be206f-1554-46fe-9fa7-581d2d394865 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:37.700900 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-946131b3-24dd-42dd-bfac-2330636a0242 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:37.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-946131b3-24dd-42dd-bfac-2330636a0242 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1319 microversion: 2.1 time: 0.191872 Jun 03 15:33:37.709781 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 456/888] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:37 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:38.579701 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-5991498b-44d1-447f-b512-af99f9b8c6f6 req-be3a53db-e02a-470f-978d-d00bf97c475d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad1307c-04fc-4558-9d69-49236090c8b1", "name": "network-vif-plugged", "status": "completed", "tag": "53d986f2-9b7e-4d47-98b6-97e16d55aae9"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:38.588232 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-5991498b-44d1-447f-b512-af99f9b8c6f6 req-be3a53db-e02a-470f-978d-d00bf97c475d service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:38.588818 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-5991498b-44d1-447f-b512-af99f9b8c6f6 req-be3a53db-e02a-470f-978d-d00bf97c475d service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:38.601192 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-5991498b-44d1-447f-b512-af99f9b8c6f6 req-be3a53db-e02a-470f-978d-d00bf97c475d service nova] Creating event network-vif-plugged:53d986f2-9b7e-4d47-98b6-97e16d55aae9 for instance 6ad1307c-04fc-4558-9d69-49236090c8b1 on hv-cinder-83124 Jun 03 15:33:38.606508 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-5991498b-44d1-447f-b512-af99f9b8c6f6 req-be3a53db-e02a-470f-978d-d00bf97c475d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031135 Jun 03 15:33:38.607397 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 433/889] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:38.729147 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f2af0cda-9a24-4f4e-bd67-835c8186e6c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:38.729756 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f2af0cda-9a24-4f4e-bd67-835c8186e6c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:38.736371 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f2af0cda-9a24-4f4e-bd67-835c8186e6c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:38.736830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f2af0cda-9a24-4f4e-bd67-835c8186e6c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:38.737600 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f2af0cda-9a24-4f4e-bd67-835c8186e6c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:38.738044 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f2af0cda-9a24-4f4e-bd67-835c8186e6c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:38.793768 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6362e9a0-72f2-49e1-9358-7ade76a7d4b3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:38.794969 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6362e9a0-72f2-49e1-9358-7ade76a7d4b3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:38.801498 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6362e9a0-72f2-49e1-9358-7ade76a7d4b3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:38.801970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6362e9a0-72f2-49e1-9358-7ade76a7d4b3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:38.802958 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6362e9a0-72f2-49e1-9358-7ade76a7d4b3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:38.803419 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6362e9a0-72f2-49e1-9358-7ade76a7d4b3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:38.837649 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6362e9a0-72f2-49e1-9358-7ade76a7d4b3 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049128 Jun 03 15:33:38.838214 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 434/890] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:38 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:33:38.986140 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8aa9fda9-9e49-4681-afbb-f7bb7f1f7121 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:38.986682 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8aa9fda9-9e49-4681-afbb-f7bb7f1f7121 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:38.992905 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8aa9fda9-9e49-4681-afbb-f7bb7f1f7121 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:38.993355 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8aa9fda9-9e49-4681-afbb-f7bb7f1f7121 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:38.994131 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8aa9fda9-9e49-4681-afbb-f7bb7f1f7121 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:38.994727 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8aa9fda9-9e49-4681-afbb-f7bb7f1f7121 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:39.011112 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f2af0cda-9a24-4f4e-bd67-835c8186e6c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:39.025576 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f2af0cda-9a24-4f4e-bd67-835c8186e6c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1319 microversion: 2.1 time: 0.299841 Jun 03 15:33:39.026423 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8aa9fda9-9e49-4681-afbb-f7bb7f1f7121 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments/290e6e67-ef27-413b-95c8-30447b33eca6" status: 200 len: 194 microversion: 2.1 time: 0.044147 Jun 03 15:33:39.026930 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 457/891] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:38 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:39.034836 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 435/892] 10.222.0.93 () {58 vars in 1412 bytes} [Fri Jun 3 15:33:38 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments/290e6e67-ef27-413b-95c8-30447b33eca6 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:33:39.038498 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a0a63b01-7438-41a6-9188-a9c7fa295fad tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:39.039282 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a0a63b01-7438-41a6-9188-a9c7fa295fad tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:39.047915 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a0a63b01-7438-41a6-9188-a9c7fa295fad tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:39.048499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a0a63b01-7438-41a6-9188-a9c7fa295fad tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:39.049371 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a0a63b01-7438-41a6-9188-a9c7fa295fad tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:39.049886 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a0a63b01-7438-41a6-9188-a9c7fa295fad tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:39.143446 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-a0a63b01-7438-41a6-9188-a9c7fa295fad tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lazy-loading 'services' on Instance uuid 697213d5-1b86-415b-bba2-8c09be059aae {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:33:39.234405 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a0a63b01-7438-41a6-9188-a9c7fa295fad tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "DELETE /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments/290e6e67-ef27-413b-95c8-30447b33eca6" status: 202 len: 0 microversion: 2.1 time: 0.200604 Jun 03 15:33:39.235325 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 458/893] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:33:39 2022] DELETE /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments/290e6e67-ef27-413b-95c8-30447b33eca6 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:33:40.046751 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9bd2acc8-dcd1-4c16-b1e3-e4d33f8249fb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:40.047373 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9bd2acc8-dcd1-4c16-b1e3-e4d33f8249fb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:40.054425 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9bd2acc8-dcd1-4c16-b1e3-e4d33f8249fb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:40.055105 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9bd2acc8-dcd1-4c16-b1e3-e4d33f8249fb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:40.056172 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9bd2acc8-dcd1-4c16-b1e3-e4d33f8249fb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:40.056823 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9bd2acc8-dcd1-4c16-b1e3-e4d33f8249fb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:40.197631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9bd2acc8-dcd1-4c16-b1e3-e4d33f8249fb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:40.205655 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9bd2acc8-dcd1-4c16-b1e3-e4d33f8249fb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1319 microversion: 2.1 time: 0.165293 Jun 03 15:33:40.206227 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 436/894] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:40 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:41.225000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-98ccd7b2-ecfe-4019-9024-f0d99a614ded tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:41.225951 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-98ccd7b2-ecfe-4019-9024-f0d99a614ded tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:41.237132 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98ccd7b2-ecfe-4019-9024-f0d99a614ded tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:41.237944 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98ccd7b2-ecfe-4019-9024-f0d99a614ded tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:41.239009 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98ccd7b2-ecfe-4019-9024-f0d99a614ded tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:41.239665 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-98ccd7b2-ecfe-4019-9024-f0d99a614ded tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:41.422117 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-aff3f42a-8538-47f4-b6d9-83deec72fd84 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:41.422834 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-aff3f42a-8538-47f4-b6d9-83deec72fd84 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:41.425912 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:41.426618 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=8 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:41.432456 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-aff3f42a-8538-47f4-b6d9-83deec72fd84 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:41.432906 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-aff3f42a-8538-47f4-b6d9-83deec72fd84 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:41.433691 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-aff3f42a-8538-47f4-b6d9-83deec72fd84 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:41.434125 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-aff3f42a-8538-47f4-b6d9-83deec72fd84 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:41.470612 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-aff3f42a-8538-47f4-b6d9-83deec72fd84 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments/ceed3827-4627-4e0f-953e-4ea967965c30" status: 200 len: 194 microversion: 2.1 time: 0.053870 Jun 03 15:33:41.471209 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 437/895] 10.222.0.93 () {58 vars in 1412 bytes} [Fri Jun 3 15:33:41 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments/ceed3827-4627-4e0f-953e-4ea967965c30 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:41.481203 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4033e4ca-ebfa-4071-93ae-78fe69e7be51 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:41.481914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4033e4ca-ebfa-4071-93ae-78fe69e7be51 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:41.489080 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4033e4ca-ebfa-4071-93ae-78fe69e7be51 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:41.489881 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4033e4ca-ebfa-4071-93ae-78fe69e7be51 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:41.490697 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4033e4ca-ebfa-4071-93ae-78fe69e7be51 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:41.491286 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4033e4ca-ebfa-4071-93ae-78fe69e7be51 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:41.498460 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-98ccd7b2-ecfe-4019-9024-f0d99a614ded tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:41.519001 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-98ccd7b2-ecfe-4019-9024-f0d99a614ded tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1508 microversion: 2.1 time: 0.299095 Jun 03 15:33:41.521314 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 459/896] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:41 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:41.593227 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-4033e4ca-ebfa-4071-93ae-78fe69e7be51 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lazy-loading 'services' on Instance uuid 697213d5-1b86-415b-bba2-8c09be059aae {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:33:41.743285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4033e4ca-ebfa-4071-93ae-78fe69e7be51 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "DELETE /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments/ceed3827-4627-4e0f-953e-4ea967965c30" status: 202 len: 0 microversion: 2.1 time: 0.265698 Jun 03 15:33:41.743949 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 438/897] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:33:41 2022] DELETE /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments/ceed3827-4627-4e0f-953e-4ea967965c30 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:33:42.949724 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-76991189-36d3-4416-806e-e07c6bad4a4e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:42.951395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-76991189-36d3-4416-806e-e07c6bad4a4e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:42.957861 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-76991189-36d3-4416-806e-e07c6bad4a4e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:42.958309 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-76991189-36d3-4416-806e-e07c6bad4a4e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:42.959167 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-76991189-36d3-4416-806e-e07c6bad4a4e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:42.959602 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-76991189-36d3-4416-806e-e07c6bad4a4e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:42.989090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-76991189-36d3-4416-806e-e07c6bad4a4e tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043543 Jun 03 15:33:42.989656 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 460/898] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:42 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 15:33:43.103426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-eeafa87f-2d87-423b-bf2d-70d075137ed5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:43.104743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-eeafa87f-2d87-423b-bf2d-70d075137ed5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:43.111737 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eeafa87f-2d87-423b-bf2d-70d075137ed5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:43.112193 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eeafa87f-2d87-423b-bf2d-70d075137ed5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:43.113055 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eeafa87f-2d87-423b-bf2d-70d075137ed5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:43.113494 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-eeafa87f-2d87-423b-bf2d-70d075137ed5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:43.144515 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-eeafa87f-2d87-423b-bf2d-70d075137ed5 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046026 Jun 03 15:33:43.146774 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 439/899] 10.222.0.93 () {58 vars in 1301 bytes} [Fri Jun 3 15:33:43 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 15:33:43.248546 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-70913607-1e70-421e-89f0-53ead4862f7a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:43.249056 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-70913607-1e70-421e-89f0-53ead4862f7a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:43.255668 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70913607-1e70-421e-89f0-53ead4862f7a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:43.256041 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70913607-1e70-421e-89f0-53ead4862f7a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:43.256832 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70913607-1e70-421e-89f0-53ead4862f7a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:43.257274 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-70913607-1e70-421e-89f0-53ead4862f7a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:43.286941 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-70913607-1e70-421e-89f0-53ead4862f7a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Going to try to terminate instance {{(pid=117806) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:33:43.366039 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-70913607-1e70-421e-89f0-53ead4862f7a tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "DELETE /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 204 len: 0 microversion: 2.1 time: 0.121075 Jun 03 15:33:43.366899 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 461/900] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:33:43 2022] DELETE /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:33:43.375018 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ad6670eb-18dc-4ecd-9da6-0f920a153cef tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:43.375630 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ad6670eb-18dc-4ecd-9da6-0f920a153cef tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:43.381536 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad6670eb-18dc-4ecd-9da6-0f920a153cef tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:43.381990 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad6670eb-18dc-4ecd-9da6-0f920a153cef tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:43.382790 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad6670eb-18dc-4ecd-9da6-0f920a153cef tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:43.383276 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad6670eb-18dc-4ecd-9da6-0f920a153cef tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:43.516791 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ad6670eb-18dc-4ecd-9da6-0f920a153cef tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:43.524357 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ad6670eb-18dc-4ecd-9da6-0f920a153cef tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1674 microversion: 2.1 time: 0.153452 Jun 03 15:33:43.524928 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 440/901] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:43 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:44.345961 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a48be1c0-28b8-4ddd-a1b3-3bacd6aa1766 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f351b280>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:44.397498 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a48be1c0-28b8-4ddd-a1b3-3bacd6aa1766 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/c2139143-f0e3-4a38-ae66-a8bd06744da5" status: 200 len: 351 microversion: 2.1 time: 0.056215 Jun 03 15:33:44.398065 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 462/902] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:33:44 2022] GET /compute/v2.1/os-volumes/c2139143-f0e3-4a38-ae66-a8bd06744da5 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:44.541304 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0ee56959-5cb1-4128-a2cb-530cdea94933 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:44.541914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0ee56959-5cb1-4128-a2cb-530cdea94933 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:44.544332 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:44.550221 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0ee56959-5cb1-4128-a2cb-530cdea94933 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:44.550719 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0ee56959-5cb1-4128-a2cb-530cdea94933 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:44.551489 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0ee56959-5cb1-4128-a2cb-530cdea94933 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:44.551926 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0ee56959-5cb1-4128-a2cb-530cdea94933 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:44.710292 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0ee56959-5cb1-4128-a2cb-530cdea94933 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:44.720901 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0ee56959-5cb1-4128-a2cb-530cdea94933 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1674 microversion: 2.1 time: 0.183378 Jun 03 15:33:44.721691 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 441/903] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:44 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:45.742432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bcfb0888-7878-4416-865d-1e1dcebe8e1c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:45.744096 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-bcfb0888-7878-4416-865d-1e1dcebe8e1c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:45.744588 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-fcd90f54-9601-4a7e-a32a-35e6fa77a69a tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f0f1eca0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:45.753504 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bcfb0888-7878-4416-865d-1e1dcebe8e1c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:45.753726 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bcfb0888-7878-4416-865d-1e1dcebe8e1c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:45.754909 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bcfb0888-7878-4416-865d-1e1dcebe8e1c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:45.756116 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bcfb0888-7878-4416-865d-1e1dcebe8e1c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:45.800345 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-fcd90f54-9601-4a7e-a32a-35e6fa77a69a tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/55529636-99d4-4b25-94ff-d7abaf64cbb7" status: 200 len: 350 microversion: 2.1 time: 0.060056 Jun 03 15:33:45.801009 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 442/904] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:33:45 2022] GET /compute/v2.1/os-volumes/55529636-99d4-4b25-94ff-d7abaf64cbb7 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:33:46.010811 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-bcfb0888-7878-4416-865d-1e1dcebe8e1c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:46.032737 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-bcfb0888-7878-4416-865d-1e1dcebe8e1c tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1674 microversion: 2.1 time: 0.297067 Jun 03 15:33:46.033112 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 463/905] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:45 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1674 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:46.607258 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-8a880022-8ba4-4b62-ae90-7e85d02fa5c3 req-7e2650f2-fa5a-44a8-af4b-92e1aceb28ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697213d5-1b86-415b-bba2-8c09be059aae", "name": "network-vif-deleted", "tag": "017c3110-af95-4653-ab4b-2de2cf82c63b"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:46.618652 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-8a880022-8ba4-4b62-ae90-7e85d02fa5c3 req-7e2650f2-fa5a-44a8-af4b-92e1aceb28ff service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:46.619554 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-8a880022-8ba4-4b62-ae90-7e85d02fa5c3 req-7e2650f2-fa5a-44a8-af4b-92e1aceb28ff service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:46.621007 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-63eff19f-9eba-4c3a-ad1f-3c55a1e6ffe1 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:46.621520 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-63eff19f-9eba-4c3a-ad1f-3c55a1e6ffe1 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:46.631162 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63eff19f-9eba-4c3a-ad1f-3c55a1e6ffe1 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:46.631608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63eff19f-9eba-4c3a-ad1f-3c55a1e6ffe1 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:46.632382 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63eff19f-9eba-4c3a-ad1f-3c55a1e6ffe1 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:46.633071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-63eff19f-9eba-4c3a-ad1f-3c55a1e6ffe1 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:46.645497 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-8a880022-8ba4-4b62-ae90-7e85d02fa5c3 req-7e2650f2-fa5a-44a8-af4b-92e1aceb28ff service nova] Creating event network-vif-deleted:017c3110-af95-4653-ab4b-2de2cf82c63b for instance 697213d5-1b86-415b-bba2-8c09be059aae on hv-cinder-83124 Jun 03 15:33:46.652542 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-8a880022-8ba4-4b62-ae90-7e85d02fa5c3 req-7e2650f2-fa5a-44a8-af4b-92e1aceb28ff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050118 Jun 03 15:33:46.657944 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 443/906] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:46.663715 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-f7e9ed4d-4368-400a-8bf7-275d08ba6bd0 req-15b7783e-af85-4ba9-855d-a6f2247f3f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800d0eab-3550-4b55-8837-765681285f77", "tag": "5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:46.674043 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-f7e9ed4d-4368-400a-8bf7-275d08ba6bd0 req-15b7783e-af85-4ba9-855d-a6f2247f3f30 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:46.674930 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-f7e9ed4d-4368-400a-8bf7-275d08ba6bd0 req-15b7783e-af85-4ba9-855d-a6f2247f3f30 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:46.689790 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-f7e9ed4d-4368-400a-8bf7-275d08ba6bd0 req-15b7783e-af85-4ba9-855d-a6f2247f3f30 service nova] Creating event network-changed:5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533 for instance 800d0eab-3550-4b55-8837-765681285f77 on hv-cinder-83124 Jun 03 15:33:46.692621 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-63eff19f-9eba-4c3a-ad1f-3c55a1e6ffe1 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Going to try to terminate instance {{(pid=117806) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:33:46.699425 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-f7e9ed4d-4368-400a-8bf7-275d08ba6bd0 req-15b7783e-af85-4ba9-855d-a6f2247f3f30 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039605 Jun 03 15:33:46.700385 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 444/907] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:46.709395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:46.844567 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-63eff19f-9eba-4c3a-ad1f-3c55a1e6ffe1 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 204 len: 0 microversion: 2.1 time: 0.226790 Jun 03 15:33:46.852841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 464/908] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:33:46 2022] DELETE /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:33:46.863250 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e7c8db43-165d-4016-a86a-8e6238c702e4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:46.866335 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e7c8db43-165d-4016-a86a-8e6238c702e4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:46.888885 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e7c8db43-165d-4016-a86a-8e6238c702e4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:46.890679 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e7c8db43-165d-4016-a86a-8e6238c702e4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:46.891676 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e7c8db43-165d-4016-a86a-8e6238c702e4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:46.892626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e7c8db43-165d-4016-a86a-8e6238c702e4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:47.050192 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:47.050938 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:47.057387 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:47.057762 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:47.058776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:47.058934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e7c8db43-165d-4016-a86a-8e6238c702e4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:47.059553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:47.069799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e7c8db43-165d-4016-a86a-8e6238c702e4 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.212360 Jun 03 15:33:47.082877 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 445/909] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:46 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:47.105410 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:47.105862 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:47.106322 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lazy-loading 'fault' on Instance uuid 697213d5-1b86-415b-bba2-8c09be059aae {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:33:47.163230 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:47.172789 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7f28eed5-01d9-48a4-944b-b352e26219f0 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1328 microversion: 2.1 time: 0.126786 Jun 03 15:33:47.183997 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 465/910] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:47 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:33:47.205754 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-dc221168-89a7-4d45-87fe-684c43968609 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f0eab280>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:47.259709 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-dc221168-89a7-4d45-87fe-684c43968609 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/5e5d1e61-e6e6-4a9c-97b2-ab6325af5a4c" status: 200 len: 350 microversion: 2.1 time: 0.057631 Jun 03 15:33:47.260709 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 446/911] 10.222.0.93 () {58 vars in 1244 bytes} [Fri Jun 3 15:33:47 2022] GET /compute/v2.1/os-volumes/5e5d1e61-e6e6-4a9c-97b2-ab6325af5a4c => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:47.273264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-de05a9d0-2a80-4ea2-bac8-b2b63d83a6e1 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f0cbd0d0>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:47.359353 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-de05a9d0-2a80-4ea2-bac8-b2b63d83a6e1 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090017 Jun 03 15:33:47.360344 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 466/912] 10.222.0.93 () {58 vars in 1133 bytes} [Fri Jun 3 15:33:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:47.374666 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8bcd5369-564a-4923-9b7a-218ebc0d93a2 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f0f2f1f0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:47.466066 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8bcd5369-564a-4923-9b7a-218ebc0d93a2 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.096135 Jun 03 15:33:47.467306 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 447/913] 10.222.0.93 () {58 vars in 1148 bytes} [Fri Jun 3 15:33:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:47.480775 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-18cb1144-f4dc-4888-ba21-8eb927b896eb tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f0c73040>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:47.570484 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-18cb1144-f4dc-4888-ba21-8eb927b896eb tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094597 Jun 03 15:33:47.571100 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 467/914] 10.222.0.93 () {58 vars in 1133 bytes} [Fri Jun 3 15:33:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:47.582314 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0fdd7780-e431-4939-9e7e-16c903289311 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f107bca0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:47.674502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0fdd7780-e431-4939-9e7e-16c903289311 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095901 Jun 03 15:33:47.675137 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 448/915] 10.222.0.93 () {58 vars in 1166 bytes} [Fri Jun 3 15:33:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:47.688062 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7f478d23-5208-4f4d-b833-d0de7a78ad8a tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f0b8fe50>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:47.785656 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7f478d23-5208-4f4d-b833-d0de7a78ad8a tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.101655 Jun 03 15:33:47.786280 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 468/916] 10.222.0.93 () {58 vars in 1169 bytes} [Fri Jun 3 15:33:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:47.799719 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-006c8e63-b30c-4ad6-9d34-36455bb08e9c tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f107b5e0>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:47.894268 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-006c8e63-b30c-4ad6-9d34-36455bb08e9c tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.098916 Jun 03 15:33:47.898827 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 449/917] 10.222.0.93 () {58 vars in 1154 bytes} [Fri Jun 3 15:33:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:47.907425 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7ca69d79-c506-4121-bf46-63f73aa83640 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f0b8f790>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:48.088687 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-00015fae-5d93-42e3-a9c8-f6cf2fa8f7fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:48.089304 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-00015fae-5d93-42e3-a9c8-f6cf2fa8f7fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:48.096720 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-00015fae-5d93-42e3-a9c8-f6cf2fa8f7fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:48.097255 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-00015fae-5d93-42e3-a9c8-f6cf2fa8f7fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:48.098023 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-00015fae-5d93-42e3-a9c8-f6cf2fa8f7fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:48.098493 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-00015fae-5d93-42e3-a9c8-f6cf2fa8f7fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:48.169199 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7ca69d79-c506-4121-bf46-63f73aa83640 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.266339 Jun 03 15:33:48.169906 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 469/918] 10.222.0.93 () {58 vars in 1187 bytes} [Fri Jun 3 15:33:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:48.181923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4f8f87a8-0fdb-4776-a0d6-829d2d304c67 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] Calling method '.version_select at 0x7f92f0c73040>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:48.246368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-00015fae-5d93-42e3-a9c8-f6cf2fa8f7fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:48.254457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-00015fae-5d93-42e3-a9c8-f6cf2fa8f7fc tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.169955 Jun 03 15:33:48.255048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 450/919] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:48 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:33:48.259615 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:48.260639 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:48.267310 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:48.267559 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4f8f87a8-0fdb-4776-a0d6-829d2d304c67 tempest-VolumesTestJSON-1273526125 tempest-VolumesTestJSON-1273526125-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089213 Jun 03 15:33:48.267763 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:48.268125 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 470/920] 10.222.0.93 () {58 vars in 1154 bytes} [Fri Jun 3 15:33:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:48.268598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:48.269119 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:48.303456 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:48.303911 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:48.304457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lazy-loading 'fault' on Instance uuid 697213d5-1b86-415b-bba2-8c09be059aae {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:33:48.349837 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632496bdc1b4d06a74caf483c8b0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16edd3f309d54728882acc6d23f8861e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:48.357613 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9705953b-d65c-481e-85af-f8ee8e8a813f tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 200 len: 1328 microversion: 2.1 time: 0.101379 Jun 03 15:33:48.358231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 451/921] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:48 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:49.272908 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-49d6c2b8-682d-41a7-a397-52acd8c3163e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:49.274672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-49d6c2b8-682d-41a7-a397-52acd8c3163e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:49.281808 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-49d6c2b8-682d-41a7-a397-52acd8c3163e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:49.282574 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-49d6c2b8-682d-41a7-a397-52acd8c3163e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:49.283531 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-49d6c2b8-682d-41a7-a397-52acd8c3163e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:49.284145 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-49d6c2b8-682d-41a7-a397-52acd8c3163e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:49.376911 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c5d95e76-00c1-4129-a21b-786830ac4298 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:49.377527 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c5d95e76-00c1-4129-a21b-786830ac4298 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:49.385717 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c5d95e76-00c1-4129-a21b-786830ac4298 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:49.386412 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c5d95e76-00c1-4129-a21b-786830ac4298 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:49.398255 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c5d95e76-00c1-4129-a21b-786830ac4298 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:49.400098 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c5d95e76-00c1-4129-a21b-786830ac4298 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:49.437141 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-c5d95e76-00c1-4129-a21b-786830ac4298 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] HTTP exception thrown: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c5d95e76-00c1-4129-a21b-786830ac4298 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Request method failure captured: Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae HTTP/1.1 Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimigy7rscMn4y1XOHOhOvCQLHFWF0UXIF2lSAAfohzLjEIY555HPP7BX0d9ZwVr19qXVeIm8cJbmWVOFyTIEuz_UX_St09oBUYlXVUrvZnSFjfecCJMriKsFf3bGaqbX6lDAjiETK2pKHYUSqxUsg-B8N2EOJ79aLtqWf6ViU8f01nb8 Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:33:49.440935 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_16edd3f309d54728882acc6d23f8861e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/16edd3f309d54728882acc6d23f8861e"}]}] Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 8632496bdc1b4d06a74caf483c8b0a42 Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:49.442367 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '697213d5-1b86-415b-bba2-8c09be059aae'} Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:49.443138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:49.444747 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:49.457832 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c5d95e76-00c1-4129-a21b-786830ac4298 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Returning 404 to user: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:49.458837 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c5d95e76-00c1-4129-a21b-786830ac4298 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 404 len: 111 microversion: 2.1 time: 0.087061 Jun 03 15:33:49.463137 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 452/922] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:49 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:33:49.467993 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-012619b2-a618-4a22-9b7e-d2f1cd74ba8b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '.version_select at 0x7f92f0eab280>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:49.505464 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-012619b2-a618-4a22-9b7e-d2f1cd74ba8b tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777162757" status: 202 len: 0 microversion: 2.1 time: 0.041199 Jun 03 15:33:49.511673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 453/923] 10.222.0.93 () {58 vars in 1220 bytes} [Fri Jun 3 15:33:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777162757 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:33:49.519492 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-49d6c2b8-682d-41a7-a397-52acd8c3163e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781d4a4643374bc6a78c3553d62f7672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f97ac03be44e0bb8ab21d985d1dd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:49.529488 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-79ebb577-9037-4d6a-9cac-9b4c798688bd req-eaf7b516-acdf-425d-8bf7-c92d30fa3631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800d0eab-3550-4b55-8837-765681285f77", "name": "network-vif-deleted", "tag": "5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:49.538633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-49d6c2b8-682d-41a7-a397-52acd8c3163e tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 200 len: 1569 microversion: 2.1 time: 0.270026 Jun 03 15:33:49.549353 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-79ebb577-9037-4d6a-9cac-9b4c798688bd req-eaf7b516-acdf-425d-8bf7-c92d30fa3631 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:49.549353 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-79ebb577-9037-4d6a-9cac-9b4c798688bd req-eaf7b516-acdf-425d-8bf7-c92d30fa3631 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:49.550797 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 471/924] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:49 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 1569 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:49.582600 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-79ebb577-9037-4d6a-9cac-9b4c798688bd req-eaf7b516-acdf-425d-8bf7-c92d30fa3631 service nova] Creating event network-vif-deleted:5fd22c4a-cf9d-4d46-8dbb-fa53b4d61533 for instance 800d0eab-3550-4b55-8837-765681285f77 on hv-cinder-83124 Jun 03 15:33:49.587673 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-79ebb577-9037-4d6a-9cac-9b4c798688bd req-eaf7b516-acdf-425d-8bf7-c92d30fa3631 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074470 Jun 03 15:33:49.592591 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 454/925] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:33:50.556904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6d9a08f1-e1dc-49b4-89c1-524064d22a94 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:50.557523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6d9a08f1-e1dc-49b4-89c1-524064d22a94 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] [instance: 800d0eab-3550-4b55-8837-765681285f77] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:50.565938 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6d9a08f1-e1dc-49b4-89c1-524064d22a94 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:50.566398 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6d9a08f1-e1dc-49b4-89c1-524064d22a94 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:50.567212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6d9a08f1-e1dc-49b4-89c1-524064d22a94 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:50.567656 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6d9a08f1-e1dc-49b4-89c1-524064d22a94 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:50.581705 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-6d9a08f1-e1dc-49b4-89c1-524064d22a94 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] HTTP exception thrown: Instance 800d0eab-3550-4b55-8837-765681285f77 could not be found. Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6d9a08f1-e1dc-49b4-89c1-524064d22a94 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Request method failure captured: Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 HTTP/1.1 Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimiiEV4_zvzsKhT8cLxzLsBp-nXFTxAWbLa2rN-JL2XQazisW_hkNGjKeiJKhf7wKwo-x4Om4o0YIsdK3IB-C6HIND9um4yfw5gem2WpY4IpY_93Kj0L1EYFcVj9AVOAI8M-O1-F-1WR3T7QbiHVBxlKzNNMTPdL0mXLRr6_mONq6OMA Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 98f97ac03be44e0bb8ab21d985d1dd27 Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-TestShelveInstance-1109754164 Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:33:50.583445 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/98f97ac03be44e0bb8ab21d985d1dd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/98f97ac03be44e0bb8ab21d985d1dd27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_98f97ac03be44e0bb8ab21d985d1dd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/98f97ac03be44e0bb8ab21d985d1dd27"}]}] Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-TestShelveInstance-1109754164 Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 98f97ac03be44e0bb8ab21d985d1dd27 Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-TestShelveInstance-1109754164 Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-TestShelveInstance-1109754164-project Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 781d4a4643374bc6a78c3553d62f7672 Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-TestShelveInstance-1109754164-project Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 800d0eab-3550-4b55-8837-765681285f77 could not be found. Jun 03 15:33:50.584829 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '800d0eab-3550-4b55-8837-765681285f77'} Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800d0eab-3550-4b55-8837-765681285f77 could not be found. Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:50.585589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800d0eab-3550-4b55-8837-765681285f77 could not be found. Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800d0eab-3550-4b55-8837-765681285f77 could not be found. Jun 03 15:33:50.587287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:50.588910 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6d9a08f1-e1dc-49b4-89c1-524064d22a94 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Returning 404 to user: Instance 800d0eab-3550-4b55-8837-765681285f77 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:50.588910 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6d9a08f1-e1dc-49b4-89c1-524064d22a94 tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77" status: 404 len: 111 microversion: 2.1 time: 0.032092 Jun 03 15:33:50.588910 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 472/926] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:50 2022] GET /compute/v2.1/servers/800d0eab-3550-4b55-8837-765681285f77 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:50.803687 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e0722878-d9f8-4b0e-8b8a-a7d4d7eb7fad tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] Calling method '.version_select at 0x7f92f10f1310>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:50.826380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e0722878-d9f8-4b0e-8b8a-a7d4d7eb7fad tempest-TestShelveInstance-1109754164 tempest-TestShelveInstance-1109754164-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-130590834" status: 202 len: 0 microversion: 2.1 time: 0.027474 Jun 03 15:33:50.827502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 455/927] 10.222.0.93 () {58 vars in 1250 bytes} [Fri Jun 3 15:33:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-130590834 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:33:51.887735 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a26e6f7c-0614-470a-bd8b-b8c71878dcfa tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:51.891653 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a26e6f7c-0614-470a-bd8b-b8c71878dcfa tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:51.910081 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a26e6f7c-0614-470a-bd8b-b8c71878dcfa tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:51.912306 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a26e6f7c-0614-470a-bd8b-b8c71878dcfa tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:51.915269 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a26e6f7c-0614-470a-bd8b-b8c71878dcfa tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:51.917602 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a26e6f7c-0614-470a-bd8b-b8c71878dcfa tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:51.969125 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a26e6f7c-0614-470a-bd8b-b8c71878dcfa tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.092438 Jun 03 15:33:51.970047 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 473/928] 10.222.0.93 () {60 vars in 1342 bytes} [Fri Jun 3 15:33:51 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:33:52.064927 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1497e279-4dd1-4ebe-b0c6-b2a6d2a47605 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:52.065665 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1497e279-4dd1-4ebe-b0c6-b2a6d2a47605 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:52.073208 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1497e279-4dd1-4ebe-b0c6-b2a6d2a47605 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:52.073997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1497e279-4dd1-4ebe-b0c6-b2a6d2a47605 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:52.074990 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1497e279-4dd1-4ebe-b0c6-b2a6d2a47605 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:52.075671 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1497e279-4dd1-4ebe-b0c6-b2a6d2a47605 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:52.103145 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1497e279-4dd1-4ebe-b0c6-b2a6d2a47605 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:33:52.178751 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:52.223502 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1497e279-4dd1-4ebe-b0c6-b2a6d2a47605 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "DELETE /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 204 len: 0 microversion: 2.20 time: 0.164368 Jun 03 15:33:52.224294 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 456/929] 10.222.0.93 () {60 vars in 1279 bytes} [Fri Jun 3 15:33:52 2022] DELETE /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 15:33:52.233836 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-8f8fe347-e32a-4cca-a34b-507852eb4616 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:52.234512 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-8f8fe347-e32a-4cca-a34b-507852eb4616 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:52.240726 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f8fe347-e32a-4cca-a34b-507852eb4616 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:52.241194 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f8fe347-e32a-4cca-a34b-507852eb4616 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:52.241997 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f8fe347-e32a-4cca-a34b-507852eb4616 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:52.242986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-8f8fe347-e32a-4cca-a34b-507852eb4616 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:52.496421 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8f8fe347-e32a-4cca-a34b-507852eb4616 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:52.505716 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7e2c8666-2d24-4121-8048-3cc529c6c299 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:52.506558 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7e2c8666-2d24-4121-8048-3cc529c6c299 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:52.507774 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8f8fe347-e32a-4cca-a34b-507852eb4616 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:52.510814 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-8f8fe347-e32a-4cca-a34b-507852eb4616 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:52.512220 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-8f8fe347-e32a-4cca-a34b-507852eb4616 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.283487 Jun 03 15:33:52.513247 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 474/930] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:52 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:52.516065 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7e2c8666-2d24-4121-8048-3cc529c6c299 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:52.516708 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7e2c8666-2d24-4121-8048-3cc529c6c299 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:52.517636 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7e2c8666-2d24-4121-8048-3cc529c6c299 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:52.518216 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7e2c8666-2d24-4121-8048-3cc529c6c299 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:52.548246 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-7e2c8666-2d24-4121-8048-3cc529c6c299 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] HTTP exception thrown: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7e2c8666-2d24-4121-8048-3cc529c6c299 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Request method failure captured: Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: DELETE /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae HTTP/1.1 Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimigy7rscMn4y1XOHOhOvCQLHFWF0UXIF2lSAAfohzLjEIY555HPP7BX0d9ZwVr19qXVeIm8cJbmWVOFyTIEuz_UX_St09oBUYlXVUrvZnSFjfecCJMriKsFf3bGaqbX6lDAjiETK2pKHYUSqxUsg-B8N2EOJ79aLtqWf6ViU8f01nb8 Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:33:52.549598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_16edd3f309d54728882acc6d23f8861e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/16edd3f309d54728882acc6d23f8861e"}]}] Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 8632496bdc1b4d06a74caf483c8b0a42 Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:52.551672 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '697213d5-1b86-415b-bba2-8c09be059aae'} Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:52.557218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:52.558812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:52.562432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7e2c8666-2d24-4121-8048-3cc529c6c299 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Returning 404 to user: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:52.562432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7e2c8666-2d24-4121-8048-3cc529c6c299 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "DELETE /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 404 len: 111 microversion: 2.1 time: 0.050826 Jun 03 15:33:52.562432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 457/931] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:33:52 2022] DELETE /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:52.572824 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bc9ec55a-37bd-4e47-9b31-e766e77fc9fb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:52.573646 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-bc9ec55a-37bd-4e47-9b31-e766e77fc9fb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: 697213d5-1b86-415b-bba2-8c09be059aae] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:52.584043 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bc9ec55a-37bd-4e47-9b31-e766e77fc9fb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:52.584501 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bc9ec55a-37bd-4e47-9b31-e766e77fc9fb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:52.585346 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bc9ec55a-37bd-4e47-9b31-e766e77fc9fb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:52.586289 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bc9ec55a-37bd-4e47-9b31-e766e77fc9fb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:52.601703 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-bc9ec55a-37bd-4e47-9b31-e766e77fc9fb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] HTTP exception thrown: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bc9ec55a-37bd-4e47-9b31-e766e77fc9fb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Request method failure captured: Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae HTTP/1.1 Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigy7rscMn4y1XOHOhOvCQLHFWF0UXIF2lSAAfohzLjEIY555HPP7BX0d9ZwVr19qXVeIm8cJbmWVOFyTIEuz_UX_St09oBUYlXVUrvZnSFjfecCJMriKsFf3bGaqbX6lDAjiETK2pKHYUSqxUsg-B8N2EOJ79aLtqWf6ViU8f01nb8 Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:33:52.603468 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_16edd3f309d54728882acc6d23f8861e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/16edd3f309d54728882acc6d23f8861e"}]}] Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 8632496bdc1b4d06a74caf483c8b0a42 Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:52.605226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '697213d5-1b86-415b-bba2-8c09be059aae'} Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:52.606133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. Jun 03 15:33:52.609073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:52.610422 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bc9ec55a-37bd-4e47-9b31-e766e77fc9fb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Returning 404 to user: Instance 697213d5-1b86-415b-bba2-8c09be059aae could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:52.610422 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-bc9ec55a-37bd-4e47-9b31-e766e77fc9fb tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae" status: 404 len: 111 microversion: 2.1 time: 0.044245 Jun 03 15:33:52.622072 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 475/932] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:52 2022] GET /compute/v2.1/servers/697213d5-1b86-415b-bba2-8c09be059aae => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:53.532377 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7178b43c-916a-40b1-9456-8f34cb6f82ee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:53.533391 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7178b43c-916a-40b1-9456-8f34cb6f82ee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:53.566457 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7178b43c-916a-40b1-9456-8f34cb6f82ee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:53.567223 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7178b43c-916a-40b1-9456-8f34cb6f82ee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:53.568412 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7178b43c-916a-40b1-9456-8f34cb6f82ee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:53.569054 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7178b43c-916a-40b1-9456-8f34cb6f82ee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:53.749898 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7178b43c-916a-40b1-9456-8f34cb6f82ee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:53.766721 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7178b43c-916a-40b1-9456-8f34cb6f82ee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:53.768542 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7178b43c-916a-40b1-9456-8f34cb6f82ee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:53.769952 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7178b43c-916a-40b1-9456-8f34cb6f82ee tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.242593 Jun 03 15:33:53.771589 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 458/933] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:53 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:53.823450 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ae1a1c4b-75bd-4f84-9101-c2b8b8955caf tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:53.823973 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ae1a1c4b-75bd-4f84-9101-c2b8b8955caf tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:53.831355 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:33:53.847432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ae1a1c4b-75bd-4f84-9101-c2b8b8955caf tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:53.847914 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ae1a1c4b-75bd-4f84-9101-c2b8b8955caf tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:53.848721 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ae1a1c4b-75bd-4f84-9101-c2b8b8955caf tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:53.849192 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ae1a1c4b-75bd-4f84-9101-c2b8b8955caf tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-ae1a1c4b-75bd-4f84-9101-c2b8b8955caf tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] HTTP exception thrown: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ae1a1c4b-75bd-4f84-9101-c2b8b8955caf tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Request method failure captured: Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: DELETE /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a HTTP/1.1 Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimigy7rscMn4y1XOHOhOvCQLHFWF0UXIF2lSAAfohzLjEIY555HPP7BX0d9ZwVr19qXVeIm8cJbmWVOFyTIEuz_UX_St09oBUYlXVUrvZnSFjfecCJMriKsFf3bGaqbX6lDAjiETK2pKHYUSqxUsg-B8N2EOJ79aLtqWf6ViU8f01nb8 Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:33:53.884907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_16edd3f309d54728882acc6d23f8861e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/16edd3f309d54728882acc6d23f8861e"}]}] Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 8632496bdc1b4d06a74caf483c8b0a42 Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:33:53.889532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'ce808322-3f17-4d8f-8d33-909ecba99d7a'} Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:53.890424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:33:53.891937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:33:53.893521 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ae1a1c4b-75bd-4f84-9101-c2b8b8955caf tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Returning 404 to user: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:53.893521 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ae1a1c4b-75bd-4f84-9101-c2b8b8955caf tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 404 len: 111 microversion: 2.1 time: 0.066485 Jun 03 15:33:53.893521 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 476/934] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:33:53 2022] DELETE /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:53.894662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c6e4423f-8f64-4d9a-a2d1-80b76f252b46 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:53.895164 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c6e4423f-8f64-4d9a-a2d1-80b76f252b46 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] [instance: ce808322-3f17-4d8f-8d33-909ecba99d7a] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:53.902620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6e4423f-8f64-4d9a-a2d1-80b76f252b46 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:53.903242 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6e4423f-8f64-4d9a-a2d1-80b76f252b46 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:53.904063 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6e4423f-8f64-4d9a-a2d1-80b76f252b46 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:53.904512 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c6e4423f-8f64-4d9a-a2d1-80b76f252b46 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:53.920579 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-c6e4423f-8f64-4d9a-a2d1-80b76f252b46 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] HTTP exception thrown: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c6e4423f-8f64-4d9a-a2d1-80b76f252b46 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Request method failure captured: Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a HTTP/1.1 Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimigy7rscMn4y1XOHOhOvCQLHFWF0UXIF2lSAAfohzLjEIY555HPP7BX0d9ZwVr19qXVeIm8cJbmWVOFyTIEuz_UX_St09oBUYlXVUrvZnSFjfecCJMriKsFf3bGaqbX6lDAjiETK2pKHYUSqxUsg-B8N2EOJ79aLtqWf6ViU8f01nb8 Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:33:53.922130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/16edd3f309d54728882acc6d23f8861e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_16edd3f309d54728882acc6d23f8861e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/16edd3f309d54728882acc6d23f8861e"}]}] Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 16edd3f309d54728882acc6d23f8861e Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1329105604 Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 8632496bdc1b4d06a74caf483c8b0a42 Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeTestJSON-1329105604-project Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:33:53.923575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': 'ce808322-3f17-4d8f-8d33-909ecba99d7a'} Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:53.924368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. Jun 03 15:33:53.925605 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:53.927805 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c6e4423f-8f64-4d9a-a2d1-80b76f252b46 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] Returning 404 to user: Instance ce808322-3f17-4d8f-8d33-909ecba99d7a could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:53.927805 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c6e4423f-8f64-4d9a-a2d1-80b76f252b46 tempest-AttachVolumeTestJSON-1329105604 tempest-AttachVolumeTestJSON-1329105604-project] 10.222.0.93 "GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a" status: 404 len: 111 microversion: 2.1 time: 0.033427 Jun 03 15:33:53.927805 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 459/935] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:33:53 2022] GET /compute/v2.1/servers/ce808322-3f17-4d8f-8d33-909ecba99d7a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:33:54.793647 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-29ff6232-5f73-490c-870a-bd32305d710d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:54.794321 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-29ff6232-5f73-490c-870a-bd32305d710d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:54.802381 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-29ff6232-5f73-490c-870a-bd32305d710d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:54.802381 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-29ff6232-5f73-490c-870a-bd32305d710d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:54.803269 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-29ff6232-5f73-490c-870a-bd32305d710d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:54.803712 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-29ff6232-5f73-490c-870a-bd32305d710d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:55.098212 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-29ff6232-5f73-490c-870a-bd32305d710d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:55.109078 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-29ff6232-5f73-490c-870a-bd32305d710d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:55.111778 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-29ff6232-5f73-490c-870a-bd32305d710d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:55.113266 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-29ff6232-5f73-490c-870a-bd32305d710d tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1723 microversion: 2.20 time: 0.323504 Jun 03 15:33:55.114012 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 477/936] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:54 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:55.687907 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-00567db7-0486-478f-943b-0956aaccbc87 req-295d6edd-37cf-438d-b6fd-46b8f4c78ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43beed7e-5952-4cc8-89ea-8c819ceb44de", "name": "network-vif-deleted", "tag": "009f1a65-b949-4493-a4fc-88ecafb96c71"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:55.700652 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-00567db7-0486-478f-943b-0956aaccbc87 req-295d6edd-37cf-438d-b6fd-46b8f4c78ccf service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:55.701893 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-00567db7-0486-478f-943b-0956aaccbc87 req-295d6edd-37cf-438d-b6fd-46b8f4c78ccf service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:55.717451 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-00567db7-0486-478f-943b-0956aaccbc87 req-295d6edd-37cf-438d-b6fd-46b8f4c78ccf service nova] Creating event network-vif-deleted:009f1a65-b949-4493-a4fc-88ecafb96c71 for instance 43beed7e-5952-4cc8-89ea-8c819ceb44de on hv-cinder-83124 Jun 03 15:33:55.732273 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-00567db7-0486-478f-943b-0956aaccbc87 req-295d6edd-37cf-438d-b6fd-46b8f4c78ccf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047234 Jun 03 15:33:55.734274 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 460/937] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:33:56.134172 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:56.135030 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:56.145130 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:56.145827 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:56.146857 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:56.147883 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:56.205104 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:56.205735 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:56.206345 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lazy-loading 'fault' on Instance uuid 43beed7e-5952-4cc8-89ea-8c819ceb44de {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:33:56.403118 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:56.418395 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:56.421856 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d7587d10b3487688ed251a85b83c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b930cadb2dc4e49947db0514528617d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:33:56.426033 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-05e4a948-67ad-4eaa-b56a-e6cf6a926925 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 200 len: 1370 microversion: 2.20 time: 0.297089 Jun 03 15:33:56.426637 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 478/938] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:56 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 15:33:57.446811 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b7dafa78-a2b8-47df-8959-587fc398afe9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:57.447510 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b7dafa78-a2b8-47df-8959-587fc398afe9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:57.466619 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b7dafa78-a2b8-47df-8959-587fc398afe9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:57.467082 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b7dafa78-a2b8-47df-8959-587fc398afe9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:57.467871 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b7dafa78-a2b8-47df-8959-587fc398afe9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:57.468302 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b7dafa78-a2b8-47df-8959-587fc398afe9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:57.503575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-b7dafa78-a2b8-47df-8959-587fc398afe9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] HTTP exception thrown: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b7dafa78-a2b8-47df-8959-587fc398afe9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Request method failure captured: Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de HTTP/1.1 Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimihI4URsvyYFvhDathagTTdPKdj6XVGiCBU9lcp_hT6pwVjQ1hJutaB1k-rB_p8nu-EG4gcrwbZ_UuuwSFQWm7rcD1ClXa0WxMSG73DDJD0zz0FSWh2yKgqcE3vbCNh3Zxxj1ujVuAr2KwUNJ49O1bACUs1o66yZXNhbOXTWQJSKyMY Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:33:57.510760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1b930cadb2dc4e49947db0514528617d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1b930cadb2dc4e49947db0514528617d"}]}] Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 47d7587d10b3487688ed251a85b83c97 Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:33:57.512312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '43beed7e-5952-4cc8-89ea-8c819ceb44de'} Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:33:57.513194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:33:57.514662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:33:57.518166 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b7dafa78-a2b8-47df-8959-587fc398afe9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Returning 404 to user: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:33:57.520086 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b7dafa78-a2b8-47df-8959-587fc398afe9 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 404 len: 111 microversion: 2.20 time: 0.078018 Jun 03 15:33:57.520721 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 461/939] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:33:57 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:33:57.532673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-38c542cd-6d6a-4007-af96-10a48b64f4dd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '.version_select at 0x7f92f0b0faf0>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:33:57.565679 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-38c542cd-6d6a-4007-af96-10a48b64f4dd tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955430949" status: 204 len: 0 microversion: 2.20 time: 0.038412 Jun 03 15:33:57.567150 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 479/940] 10.222.0.93 () {60 vars in 1258 bytes} [Fri Jun 3 15:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955430949 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 15:33:59.402191 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4868dd7f-607b-4c68-9853-1db8a8738e81 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24001d51-31e0-4cd2-9819-201b879d9e8a", "device": "/dev/sdb"}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:33:59.426569 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4868dd7f-607b-4c68-9853-1db8a8738e81 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:33:59.470015 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4868dd7f-607b-4c68-9853-1db8a8738e81 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:59.472342 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4868dd7f-607b-4c68-9853-1db8a8738e81 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:59.477102 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4868dd7f-607b-4c68-9853-1db8a8738e81 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:33:59.480238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4868dd7f-607b-4c68-9853-1db8a8738e81 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:33:59.990415 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4868dd7f-607b-4c68-9853-1db8a8738e81 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "POST /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.607950 Jun 03 15:33:59.991201 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 462/941] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:33:59 2022] POST /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1/os-volume_attachments => generated 194 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:34:00.648721 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-003cb71d-a28a-4bf5-a27c-876370d93c01 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:00.649210 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-003cb71d-a28a-4bf5-a27c-876370d93c01 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:00.656736 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-003cb71d-a28a-4bf5-a27c-876370d93c01 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:00.658757 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-003cb71d-a28a-4bf5-a27c-876370d93c01 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:00.660713 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-003cb71d-a28a-4bf5-a27c-876370d93c01 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:00.663823 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-003cb71d-a28a-4bf5-a27c-876370d93c01 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:00.705552 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-003cb71d-a28a-4bf5-a27c-876370d93c01 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] HTTP exception thrown: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-003cb71d-a28a-4bf5-a27c-876370d93c01 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Request method failure captured: Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: DELETE /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de HTTP/1.1 Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimihI4URsvyYFvhDathagTTdPKdj6XVGiCBU9lcp_hT6pwVjQ1hJutaB1k-rB_p8nu-EG4gcrwbZ_UuuwSFQWm7rcD1ClXa0WxMSG73DDJD0zz0FSWh2yKgqcE3vbCNh3Zxxj1ujVuAr2KwUNJ49O1bACUs1o66yZXNhbOXTWQJSKyMY Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:34:00.707710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1b930cadb2dc4e49947db0514528617d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1b930cadb2dc4e49947db0514528617d"}]}] Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 47d7587d10b3487688ed251a85b83c97 Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:34:00.709218 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '43beed7e-5952-4cc8-89ea-8c819ceb44de'} Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:34:00.709972 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:34:00.711326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:00.712563 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-003cb71d-a28a-4bf5-a27c-876370d93c01 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Returning 404 to user: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:34:00.712563 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-003cb71d-a28a-4bf5-a27c-876370d93c01 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "DELETE /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 404 len: 111 microversion: 2.20 time: 0.064468 Jun 03 15:34:00.712563 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 480/942] 10.222.0.93 () {60 vars in 1279 bytes} [Fri Jun 3 15:34:00 2022] DELETE /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:34:00.721689 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3d991cb4-eb83-4370-95e7-57d9f83321d2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:00.722393 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-3d991cb4-eb83-4370-95e7-57d9f83321d2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: 43beed7e-5952-4cc8-89ea-8c819ceb44de] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:00.736966 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d991cb4-eb83-4370-95e7-57d9f83321d2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:00.737347 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d991cb4-eb83-4370-95e7-57d9f83321d2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:00.738096 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d991cb4-eb83-4370-95e7-57d9f83321d2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:00.738556 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-3d991cb4-eb83-4370-95e7-57d9f83321d2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:00.768403 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-3d991cb4-eb83-4370-95e7-57d9f83321d2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] HTTP exception thrown: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3d991cb4-eb83-4370-95e7-57d9f83321d2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Request method failure captured: Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de HTTP/1.1 Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimihI4URsvyYFvhDathagTTdPKdj6XVGiCBU9lcp_hT6pwVjQ1hJutaB1k-rB_p8nu-EG4gcrwbZ_UuuwSFQWm7rcD1ClXa0WxMSG73DDJD0zz0FSWh2yKgqcE3vbCNh3Zxxj1ujVuAr2KwUNJ49O1bACUs1o66yZXNhbOXTWQJSKyMY Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:34:00.771453 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1b930cadb2dc4e49947db0514528617d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1b930cadb2dc4e49947db0514528617d"}]}] Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 47d7587d10b3487688ed251a85b83c97 Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:34:00.772856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '43beed7e-5952-4cc8-89ea-8c819ceb44de'} Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:34:00.773806 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. Jun 03 15:34:00.775617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:34:00.777977 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-3d991cb4-eb83-4370-95e7-57d9f83321d2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Returning 404 to user: Instance 43beed7e-5952-4cc8-89ea-8c819ceb44de could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:34:00.777977 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-3d991cb4-eb83-4370-95e7-57d9f83321d2 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de" status: 404 len: 111 microversion: 2.20 time: 0.056467 Jun 03 15:34:00.777977 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 463/943] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:34:00 2022] GET /compute/v2.1/servers/43beed7e-5952-4cc8-89ea-8c819ceb44de => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:34:01.981053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-20519cc8-dfdc-4aaf-93c9-2f5e551c5cb6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:01.981584 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-20519cc8-dfdc-4aaf-93c9-2f5e551c5cb6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:01.991285 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20519cc8-dfdc-4aaf-93c9-2f5e551c5cb6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:01.991983 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20519cc8-dfdc-4aaf-93c9-2f5e551c5cb6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:01.993258 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20519cc8-dfdc-4aaf-93c9-2f5e551c5cb6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:01.993778 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-20519cc8-dfdc-4aaf-93c9-2f5e551c5cb6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:02.016157 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-20519cc8-dfdc-4aaf-93c9-2f5e551c5cb6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] HTTP exception thrown: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-20519cc8-dfdc-4aaf-93c9-2f5e551c5cb6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Request method failure captured: Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: DELETE /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c HTTP/1.1 Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimihI4URsvyYFvhDathagTTdPKdj6XVGiCBU9lcp_hT6pwVjQ1hJutaB1k-rB_p8nu-EG4gcrwbZ_UuuwSFQWm7rcD1ClXa0WxMSG73DDJD0zz0FSWh2yKgqcE3vbCNh3Zxxj1ujVuAr2KwUNJ49O1bACUs1o66yZXNhbOXTWQJSKyMY Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:34:02.018516 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1b930cadb2dc4e49947db0514528617d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1b930cadb2dc4e49947db0514528617d"}]}] Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 47d7587d10b3487688ed251a85b83c97 Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:34:02.019923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': 'e123dc0c-78c6-44ce-b847-927843a3751c'} Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:34:02.020672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:34:02.022006 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:02.023521 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-20519cc8-dfdc-4aaf-93c9-2f5e551c5cb6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Returning 404 to user: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:34:02.023521 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-20519cc8-dfdc-4aaf-93c9-2f5e551c5cb6 tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 404 len: 111 microversion: 2.20 time: 0.043453 Jun 03 15:34:02.023521 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 481/944] 10.222.0.93 () {60 vars in 1279 bytes} [Fri Jun 3 15:34:01 2022] DELETE /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:34:02.030069 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e167526d-125e-4bc1-ba87-a7d32a27da7a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:02.030730 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e167526d-125e-4bc1-ba87-a7d32a27da7a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] [instance: e123dc0c-78c6-44ce-b847-927843a3751c] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:02.037538 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e167526d-125e-4bc1-ba87-a7d32a27da7a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:02.037991 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e167526d-125e-4bc1-ba87-a7d32a27da7a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:02.038790 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e167526d-125e-4bc1-ba87-a7d32a27da7a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:02.039243 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e167526d-125e-4bc1-ba87-a7d32a27da7a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:02.056368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-e167526d-125e-4bc1-ba87-a7d32a27da7a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] HTTP exception thrown: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e167526d-125e-4bc1-ba87-a7d32a27da7a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Request method failure captured: Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c HTTP/1.1 Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimihI4URsvyYFvhDathagTTdPKdj6XVGiCBU9lcp_hT6pwVjQ1hJutaB1k-rB_p8nu-EG4gcrwbZ_UuuwSFQWm7rcD1ClXa0WxMSG73DDJD0zz0FSWh2yKgqcE3vbCNh3Zxxj1ujVuAr2KwUNJ49O1bACUs1o66yZXNhbOXTWQJSKyMY Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:34:02.058226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b930cadb2dc4e49947db0514528617d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1b930cadb2dc4e49947db0514528617d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1b930cadb2dc4e49947db0514528617d"}]}] Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 1b930cadb2dc4e49947db0514528617d Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1536890195 Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 47d7587d10b3487688ed251a85b83c97 Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1536890195-project Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:34:02.060688 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': 'e123dc0c-78c6-44ce-b847-927843a3751c'} Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:34:02.065252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. Jun 03 15:34:02.068308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:34:02.069697 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e167526d-125e-4bc1-ba87-a7d32a27da7a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] Returning 404 to user: Instance e123dc0c-78c6-44ce-b847-927843a3751c could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:34:02.069697 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e167526d-125e-4bc1-ba87-a7d32a27da7a tempest-AttachVolumeShelveTestJSON-1536890195 tempest-AttachVolumeShelveTestJSON-1536890195-project] 10.222.0.93 "GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c" status: 404 len: 111 microversion: 2.20 time: 0.034906 Jun 03 15:34:02.069697 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 464/945] 10.222.0.93 () {60 vars in 1276 bytes} [Fri Jun 3 15:34:02 2022] GET /compute/v2.1/servers/e123dc0c-78c6-44ce-b847-927843a3751c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 15:34:28.552659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0ff11351-9011-4511-aa20-eaae00918107 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:28.553192 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0ff11351-9011-4511-aa20-eaae00918107 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:28.555505 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:34:28.556145 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:34:28.562659 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0ff11351-9011-4511-aa20-eaae00918107 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:28.563319 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0ff11351-9011-4511-aa20-eaae00918107 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:28.565191 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0ff11351-9011-4511-aa20-eaae00918107 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:28.565646 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0ff11351-9011-4511-aa20-eaae00918107 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:28.657016 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-0ff11351-9011-4511-aa20-eaae00918107 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lazy-loading 'services' on Instance uuid 6ad1307c-04fc-4558-9d69-49236090c8b1 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:34:28.752230 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0ff11351-9011-4511-aa20-eaae00918107 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1/os-volume_attachments/24001d51-31e0-4cd2-9819-201b879d9e8a" status: 202 len: 0 microversion: 2.1 time: 0.203284 Jun 03 15:34:28.752828 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 482/946] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:34:28 2022] DELETE /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1/os-volume_attachments/24001d51-31e0-4cd2-9819-201b879d9e8a => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:34:29.871582 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-80655abd-58a3-44b4-a311-6d7addb4c900 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:29.872138 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-80655abd-58a3-44b4-a311-6d7addb4c900 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:29.875296 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:34:29.875947 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=29,nova_cell1:UPDATE=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:34:29.881860 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80655abd-58a3-44b4-a311-6d7addb4c900 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:29.882318 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80655abd-58a3-44b4-a311-6d7addb4c900 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:29.883122 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80655abd-58a3-44b4-a311-6d7addb4c900 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:29.883568 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-80655abd-58a3-44b4-a311-6d7addb4c900 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:29.912936 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-80655abd-58a3-44b4-a311-6d7addb4c900 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:34:30.014145 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-80655abd-58a3-44b4-a311-6d7addb4c900 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 204 len: 0 microversion: 2.1 time: 0.146070 Jun 03 15:34:30.015035 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 465/947] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:34:29 2022] DELETE /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:34:30.025742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-508d2289-e30b-4ef2-a407-924a282b726b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:30.026456 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-508d2289-e30b-4ef2-a407-924a282b726b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:30.035697 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-508d2289-e30b-4ef2-a407-924a282b726b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:30.036158 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-508d2289-e30b-4ef2-a407-924a282b726b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:30.036958 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-508d2289-e30b-4ef2-a407-924a282b726b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:30.037403 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-508d2289-e30b-4ef2-a407-924a282b726b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:30.198248 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-508d2289-e30b-4ef2-a407-924a282b726b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:30.206262 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-508d2289-e30b-4ef2-a407-924a282b726b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1514 microversion: 2.1 time: 0.185073 Jun 03 15:34:30.206948 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 483/948] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:30 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:31.224148 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-0cf8220f-986c-4c79-87fd-cd5651cb96da tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:31.225467 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-0cf8220f-986c-4c79-87fd-cd5651cb96da tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:31.232467 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0cf8220f-986c-4c79-87fd-cd5651cb96da tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:31.233151 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0cf8220f-986c-4c79-87fd-cd5651cb96da tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:31.234005 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0cf8220f-986c-4c79-87fd-cd5651cb96da tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:31.234458 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-0cf8220f-986c-4c79-87fd-cd5651cb96da tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:31.406587 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-0cf8220f-986c-4c79-87fd-cd5651cb96da tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:31.416205 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-0cf8220f-986c-4c79-87fd-cd5651cb96da tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1514 microversion: 2.1 time: 0.196410 Jun 03 15:34:31.418578 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 466/949] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:31 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:32.349472 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-e4f977ef-7c47-4b5f-b1ea-b22db925b285 req-40ef36a7-7af5-46db-97bf-173785b7bb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad1307c-04fc-4558-9d69-49236090c8b1", "name": "network-vif-deleted", "tag": "53d986f2-9b7e-4d47-98b6-97e16d55aae9"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:34:32.366494 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-e4f977ef-7c47-4b5f-b1ea-b22db925b285 req-40ef36a7-7af5-46db-97bf-173785b7bb62 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:32.366999 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-e4f977ef-7c47-4b5f-b1ea-b22db925b285 req-40ef36a7-7af5-46db-97bf-173785b7bb62 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:32.385063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-e4f977ef-7c47-4b5f-b1ea-b22db925b285 req-40ef36a7-7af5-46db-97bf-173785b7bb62 service nova] Creating event network-vif-deleted:53d986f2-9b7e-4d47-98b6-97e16d55aae9 for instance 6ad1307c-04fc-4558-9d69-49236090c8b1 on hv-cinder-83124 Jun 03 15:34:32.392118 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-e4f977ef-7c47-4b5f-b1ea-b22db925b285 req-40ef36a7-7af5-46db-97bf-173785b7bb62 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046717 Jun 03 15:34:32.393258 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 484/950] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:34:32.434254 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:32.436380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:32.445667 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:32.445894 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:32.448538 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:32.449187 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:32.511608 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:32.512060 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:32.512527 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lazy-loading 'fault' on Instance uuid 6ad1307c-04fc-4558-9d69-49236090c8b1 {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:34:32.566745 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:32.583708 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f7111069-8432-4431-b397-a7129d2a05cb tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 200 len: 1309 microversion: 2.1 time: 0.153734 Jun 03 15:34:32.585080 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 467/951] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:32 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:33.603738 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-738a7261-5549-4c10-810e-949dc61ba49a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:33.604447 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-738a7261-5549-4c10-810e-949dc61ba49a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 6ad1307c-04fc-4558-9d69-49236090c8b1] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:33.613103 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-738a7261-5549-4c10-810e-949dc61ba49a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:33.613558 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-738a7261-5549-4c10-810e-949dc61ba49a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:33.614691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-738a7261-5549-4c10-810e-949dc61ba49a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:33.615286 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-738a7261-5549-4c10-810e-949dc61ba49a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:33.630628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-738a7261-5549-4c10-810e-949dc61ba49a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] HTTP exception thrown: Instance 6ad1307c-04fc-4558-9d69-49236090c8b1 could not be found. Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-738a7261-5549-4c10-810e-949dc61ba49a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Request method failure captured: Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 HTTP/1.1 Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABiminIlSFGpr1yN86emZ3zYSFA7P2OtrryYpatLWUlUekAk--eLVYqygtfwEN8bA9-TsgrHs60uoOZAbTjRKMeOECYGsbwhw5mFcaJLwiCJ7AtaQU9H0OfoPCVTe4esBDLDg0UNBboHd0FGHi4zxwzSWJeyV4JlYlbkV8bwtbXPULrumU Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: d5151421b3ee4477924cdab41025075b Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesSnapshotTestJSON-349830551 Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:34:33.632409 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d5151421b3ee4477924cdab41025075b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d5151421b3ee4477924cdab41025075b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d5151421b3ee4477924cdab41025075b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d5151421b3ee4477924cdab41025075b"}]}] Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesSnapshotTestJSON-349830551 Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: d5151421b3ee4477924cdab41025075b Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-349830551 Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesSnapshotTestJSON-349830551-project Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 5b82f76d685041d084dd5f332a5b1105 Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesSnapshotTestJSON-349830551-project Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 6ad1307c-04fc-4558-9d69-49236090c8b1 could not be found. Jun 03 15:34:33.634133 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '6ad1307c-04fc-4558-9d69-49236090c8b1'} Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad1307c-04fc-4558-9d69-49236090c8b1 could not be found. Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:34:33.635119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad1307c-04fc-4558-9d69-49236090c8b1 could not be found. Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad1307c-04fc-4558-9d69-49236090c8b1 could not be found. Jun 03 15:34:33.636952 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:33.640496 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-738a7261-5549-4c10-810e-949dc61ba49a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Returning 404 to user: Instance 6ad1307c-04fc-4558-9d69-49236090c8b1 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:34:33.641438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-738a7261-5549-4c10-810e-949dc61ba49a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1" status: 404 len: 111 microversion: 2.1 time: 0.043346 Jun 03 15:34:33.642014 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 485/952] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:33 2022] GET /compute/v2.1/servers/6ad1307c-04fc-4558-9d69-49236090c8b1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:34:46.501634 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e0ee3ca5-3339-4d0a-84d0-34eaaf65e32b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:46.502237 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e0ee3ca5-3339-4d0a-84d0-34eaaf65e32b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:46.504721 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:34:46.505363 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:34:46.512516 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e0ee3ca5-3339-4d0a-84d0-34eaaf65e32b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:46.512964 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e0ee3ca5-3339-4d0a-84d0-34eaaf65e32b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:46.513733 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e0ee3ca5-3339-4d0a-84d0-34eaaf65e32b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:46.514721 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e0ee3ca5-3339-4d0a-84d0-34eaaf65e32b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:46.543236 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e0ee3ca5-3339-4d0a-84d0-34eaaf65e32b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:34:46.628932 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e0ee3ca5-3339-4d0a-84d0-34eaaf65e32b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 204 len: 0 microversion: 2.1 time: 0.130740 Jun 03 15:34:46.630015 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 468/953] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:34:46 2022] DELETE /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:34:46.638871 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-23ffb787-a765-47ba-8fa1-97202a18f47e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:46.641162 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-23ffb787-a765-47ba-8fa1-97202a18f47e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:46.644124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=8 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:34:46.644783 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:34:46.651542 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23ffb787-a765-47ba-8fa1-97202a18f47e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:46.652008 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23ffb787-a765-47ba-8fa1-97202a18f47e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:46.652807 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23ffb787-a765-47ba-8fa1-97202a18f47e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:46.653249 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23ffb787-a765-47ba-8fa1-97202a18f47e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:46.819261 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-23ffb787-a765-47ba-8fa1-97202a18f47e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:46.828500 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-23ffb787-a765-47ba-8fa1-97202a18f47e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1577 microversion: 2.1 time: 0.194046 Jun 03 15:34:46.830037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 486/954] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:46 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:46.895168 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-311658460", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "networks": [{"uuid": "914f3c40-3d58-42c5-84f2-1921af6d0fdf"}]}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:34:46.969037 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] validate_networks() for [('914f3c40-3d58-42c5-84f2-1921af6d0fdf', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:34:47.364779 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:34:47.365211 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:34:47.365693 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:34:47.366109 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:34:47.366798 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:34:47.382091 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:47.382284 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:47.383020 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:47.383459 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:47.406991 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Getting quotas for project d5151421b3ee4477924cdab41025075b. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:34:47.418775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Getting quotas for user 5b82f76d685041d084dd5f332a5b1105 and project d5151421b3ee4477924cdab41025075b. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:34:47.435651 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:34:47.440362 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:34:47.511739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b88805b0-eda2-41e2-8ecc-da9f780e56e5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622975 Jun 03 15:34:47.516497 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 469/955] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:34:47.539190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c2a4c87f-756e-46c6-9f27-551f92fae1c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:47.541004 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c2a4c87f-756e-46c6-9f27-551f92fae1c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:47.663746 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c2a4c87f-756e-46c6-9f27-551f92fae1c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:47.672873 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c2a4c87f-756e-46c6-9f27-551f92fae1c7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1218 microversion: 2.1 time: 0.146899 Jun 03 15:34:47.674038 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 487/956] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:47 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:47.852301 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2de6c073-f1eb-4d39-a425-db5d3eda6d98 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:47.867134 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2de6c073-f1eb-4d39-a425-db5d3eda6d98 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:47.887375 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2de6c073-f1eb-4d39-a425-db5d3eda6d98 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:47.896280 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2de6c073-f1eb-4d39-a425-db5d3eda6d98 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:47.899053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2de6c073-f1eb-4d39-a425-db5d3eda6d98 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:47.899969 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2de6c073-f1eb-4d39-a425-db5d3eda6d98 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:48.107239 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2de6c073-f1eb-4d39-a425-db5d3eda6d98 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:48.115864 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2de6c073-f1eb-4d39-a425-db5d3eda6d98 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1577 microversion: 2.1 time: 0.271811 Jun 03 15:34:48.116452 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 470/957] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:47 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1577 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:48.689792 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bd669c1f-e6e3-41d9-951a-3ee07b31a13e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:48.690413 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-bd669c1f-e6e3-41d9-951a-3ee07b31a13e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:48.700809 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bd669c1f-e6e3-41d9-951a-3ee07b31a13e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:48.701679 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bd669c1f-e6e3-41d9-951a-3ee07b31a13e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:48.702460 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bd669c1f-e6e3-41d9-951a-3ee07b31a13e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:48.702922 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bd669c1f-e6e3-41d9-951a-3ee07b31a13e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:48.824630 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-bd669c1f-e6e3-41d9-951a-3ee07b31a13e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:48.844765 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-bd669c1f-e6e3-41d9-951a-3ee07b31a13e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1270 microversion: 2.1 time: 0.158196 Jun 03 15:34:48.846242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 488/958] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:48 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:49.133626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e9d8fe64-f355-4a0b-9f8d-defe573f0c43 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:49.134362 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e9d8fe64-f355-4a0b-9f8d-defe573f0c43 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:49.147644 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e9d8fe64-f355-4a0b-9f8d-defe573f0c43 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:49.148596 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e9d8fe64-f355-4a0b-9f8d-defe573f0c43 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:49.149764 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e9d8fe64-f355-4a0b-9f8d-defe573f0c43 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:49.154864 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e9d8fe64-f355-4a0b-9f8d-defe573f0c43 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:49.279279 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e9d8fe64-f355-4a0b-9f8d-defe573f0c43 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:49.294165 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e9d8fe64-f355-4a0b-9f8d-defe573f0c43 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1510 microversion: 2.1 time: 0.164622 Jun 03 15:34:49.298770 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 471/959] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:49 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:49.748233 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-3ad2b1d0-912b-4a66-8b1f-3baba0c32fd9 req-deb0f842-2b69-4ac9-ab5d-d26b1b22043f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b12e6d4-7911-4c08-a28d-aadf2beda784", "name": "network-vif-deleted", "tag": "7520f1aa-d4f8-4c3e-9b98-3e91e6261e2c"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:34:49.773033 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-3ad2b1d0-912b-4a66-8b1f-3baba0c32fd9 req-deb0f842-2b69-4ac9-ab5d-d26b1b22043f service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:49.775574 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-3ad2b1d0-912b-4a66-8b1f-3baba0c32fd9 req-deb0f842-2b69-4ac9-ab5d-d26b1b22043f service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:49.806221 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-3ad2b1d0-912b-4a66-8b1f-3baba0c32fd9 req-deb0f842-2b69-4ac9-ab5d-d26b1b22043f service nova] Creating event network-vif-deleted:7520f1aa-d4f8-4c3e-9b98-3e91e6261e2c for instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 on hv-cinder-83124 Jun 03 15:34:49.817191 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-3ad2b1d0-912b-4a66-8b1f-3baba0c32fd9 req-deb0f842-2b69-4ac9-ab5d-d26b1b22043f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073349 Jun 03 15:34:49.819569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 489/960] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:34:49.867575 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-bb90165d-470c-4636-8eb3-95fa43d61f8c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:49.868489 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-bb90165d-470c-4636-8eb3-95fa43d61f8c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:49.882760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bb90165d-470c-4636-8eb3-95fa43d61f8c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:49.883597 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bb90165d-470c-4636-8eb3-95fa43d61f8c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:49.884635 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bb90165d-470c-4636-8eb3-95fa43d61f8c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:49.886079 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-bb90165d-470c-4636-8eb3-95fa43d61f8c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:50.316293 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:50.317165 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:50.329628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:50.332773 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:50.335594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:50.337185 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:50.393816 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:50.394519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:50.395102 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lazy-loading 'fault' on Instance uuid 0b12e6d4-7911-4c08-a28d-aadf2beda784 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:34:50.453734 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:50.463019 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f78af874-581a-4faa-bfa5-2cf6fc4951ae tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 200 len: 1230 microversion: 2.1 time: 0.153185 Jun 03 15:34:50.464087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 490/961] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:50 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 1230 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:50.916043 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-bb90165d-470c-4636-8eb3-95fa43d61f8c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:50.961233 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-bb90165d-470c-4636-8eb3-95fa43d61f8c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 1.097417 Jun 03 15:34:50.965008 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 472/962] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:49 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:34:51.481791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0f308c16-deec-4130-947e-69568d9a4155 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:51.482935 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0f308c16-deec-4130-947e-69568d9a4155 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:51.495870 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0f308c16-deec-4130-947e-69568d9a4155 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:51.496597 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0f308c16-deec-4130-947e-69568d9a4155 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:51.497589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0f308c16-deec-4130-947e-69568d9a4155 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:51.498229 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0f308c16-deec-4130-947e-69568d9a4155 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:51.520845 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-0f308c16-deec-4130-947e-69568d9a4155 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] HTTP exception thrown: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0f308c16-deec-4130-947e-69568d9a4155 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Request method failure captured: Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 HTTP/1.1 Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimilTc42dAOjXGY-wUJVZyhb00vNpHWAeXziGl2xw-3CUEazCViJ7OwsSBbd-qS97uF5UYzTKZQdY9y7QsUtCEcb2B6U1XtXQSnw0YwRFsMbU3aRe-nxvt_yuXONdHLbNy0YXQp2OjpjpKJeVJnExasSrDWXrsBSgkSRPgKoJ178gvQo Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 141bd2be69f243aa926f28b96eb6f0d5 Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-TestVolumeBootPattern-974669227 Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:34:51.523744 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/141bd2be69f243aa926f28b96eb6f0d5"}]}] Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-TestVolumeBootPattern-974669227 Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 141bd2be69f243aa926f28b96eb6f0d5 Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-TestVolumeBootPattern-974669227 Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-TestVolumeBootPattern-974669227-project Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 7d53405e3f88439f81b67106ad98adc2 Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-TestVolumeBootPattern-974669227-project Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:34:51.525203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '0b12e6d4-7911-4c08-a28d-aadf2beda784'} Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:34:51.526042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:34:51.528846 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:34:51.532202 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0f308c16-deec-4130-947e-69568d9a4155 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Returning 404 to user: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:34:51.532202 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0f308c16-deec-4130-947e-69568d9a4155 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 404 len: 111 microversion: 2.1 time: 0.047896 Jun 03 15:34:51.533882 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 491/963] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:51 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:34:51.709292 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1746165128", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1350769796", "security_groups": [{"name": "tempest-secgroup-smoke-168875648"}], "block_device_mapping_v2": [{"uuid": "c80b0947-d1ad-4b76-97a4-af42d22ebba3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2d580292-795d-4fee-87ce-011961d3c846"}]}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:34:51.888264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] validate_networks() for [('2d580292-795d-4fee-87ce-011961d3c846', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:34:51.940259 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-7adf46c2-08f2-41dc-8642-112c320457a0 req-c3cb3679-aec1-425d-9ca0-d10074bd718e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e324bc-ede1-49c6-b397-7cd7eef8fe4d", "tag": "a2683068-e975-44f9-bfbb-088b723434a1"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:34:51.953859 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-7adf46c2-08f2-41dc-8642-112c320457a0 req-c3cb3679-aec1-425d-9ca0-d10074bd718e service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:51.954519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-7adf46c2-08f2-41dc-8642-112c320457a0 req-c3cb3679-aec1-425d-9ca0-d10074bd718e service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:51.994213 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-7adf46c2-08f2-41dc-8642-112c320457a0 req-c3cb3679-aec1-425d-9ca0-d10074bd718e service nova] Creating event network-changed:a2683068-e975-44f9-bfbb-088b723434a1 for instance 73e324bc-ede1-49c6-b397-7cd7eef8fe4d on hv-cinder-83124 Jun 03 15:34:52.000217 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-7adf46c2-08f2-41dc-8642-112c320457a0 req-c3cb3679-aec1-425d-9ca0-d10074bd718e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067315 Jun 03 15:34:52.001414 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 492/964] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:34:52.006943 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0d292d55-e579-4a19-a1c1-d46dba00fa26 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:52.007993 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0d292d55-e579-4a19-a1c1-d46dba00fa26 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:52.019924 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0d292d55-e579-4a19-a1c1-d46dba00fa26 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:52.020698 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0d292d55-e579-4a19-a1c1-d46dba00fa26 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:52.021487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0d292d55-e579-4a19-a1c1-d46dba00fa26 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:52.021926 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0d292d55-e579-4a19-a1c1-d46dba00fa26 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:52.233734 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0d292d55-e579-4a19-a1c1-d46dba00fa26 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:52.250269 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0d292d55-e579-4a19-a1c1-d46dba00fa26 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.244367 Jun 03 15:34:52.251678 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 493/965] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:52 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:52.755557 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:34:52.756179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:34:52.756949 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:34:52.757498 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:34:52.758090 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:34:52.772377 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:52.772946 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:52.773823 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:52.774362 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:52.801057 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Getting quotas for project 141bd2be69f243aa926f28b96eb6f0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:34:52.806293 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Getting quotas for user 7d53405e3f88439f81b67106ad98adc2 and project 141bd2be69f243aa926f28b96eb6f0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:34:52.870853 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:34:52.872795 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c80b0947-d1ad-4b76-97a4-af42d22ebba3',volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:34:53.011900 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-68a330fe-6f7f-46d8-b3b0-9cac80ed36ce tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.306674 Jun 03 15:34:53.012721 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 473/966] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:34:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:34:53.023173 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d7758885-d253-45cc-bd5a-05fa183a558a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:53.024130 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d7758885-d253-45cc-bd5a-05fa183a558a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:53.086232 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d7758885-d253-45cc-bd5a-05fa183a558a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:53.093483 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d7758885-d253-45cc-bd5a-05fa183a558a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1095 microversion: 2.1 time: 0.074274 Jun 03 15:34:53.094064 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 494/967] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:53 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:34:53.271060 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-db8e9ced-2439-429a-9550-80e10022c269 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:53.272200 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-db8e9ced-2439-429a-9550-80e10022c269 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:53.281397 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-db8e9ced-2439-429a-9550-80e10022c269 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:53.281853 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-db8e9ced-2439-429a-9550-80e10022c269 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:53.282681 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-db8e9ced-2439-429a-9550-80e10022c269 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:53.283123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-db8e9ced-2439-429a-9550-80e10022c269 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:53.433375 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-db8e9ced-2439-429a-9550-80e10022c269 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:53.441971 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-db8e9ced-2439-429a-9550-80e10022c269 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.178220 Jun 03 15:34:53.443513 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 474/968] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:53 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:54.112085 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c9d7ebe0-55e1-4151-b051-99114ed1b114 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:54.112724 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c9d7ebe0-55e1-4151-b051-99114ed1b114 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:54.120308 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c9d7ebe0-55e1-4151-b051-99114ed1b114 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:54.120767 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c9d7ebe0-55e1-4151-b051-99114ed1b114 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:54.121550 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c9d7ebe0-55e1-4151-b051-99114ed1b114 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:54.121995 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c9d7ebe0-55e1-4151-b051-99114ed1b114 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:54.183090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c9d7ebe0-55e1-4151-b051-99114ed1b114 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:54.191347 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c9d7ebe0-55e1-4151-b051-99114ed1b114 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1145 microversion: 2.1 time: 0.083932 Jun 03 15:34:54.191906 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 495/969] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:54 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:54.458889 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ad5a95b3-ec45-40fc-9723-093dd02cd916 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:54.459474 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ad5a95b3-ec45-40fc-9723-093dd02cd916 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:54.465844 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad5a95b3-ec45-40fc-9723-093dd02cd916 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:54.466286 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad5a95b3-ec45-40fc-9723-093dd02cd916 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:54.467197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad5a95b3-ec45-40fc-9723-093dd02cd916 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:54.467813 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ad5a95b3-ec45-40fc-9723-093dd02cd916 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:54.607227 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ad5a95b3-ec45-40fc-9723-093dd02cd916 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:54.615209 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ad5a95b3-ec45-40fc-9723-093dd02cd916 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.160237 Jun 03 15:34:54.615773 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 475/970] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:54 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:55.208807 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-50c29598-9229-42c6-975f-f912a59826f3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:55.209439 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-50c29598-9229-42c6-975f-f912a59826f3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:55.216028 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50c29598-9229-42c6-975f-f912a59826f3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:55.216477 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50c29598-9229-42c6-975f-f912a59826f3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:55.217235 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50c29598-9229-42c6-975f-f912a59826f3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:55.218355 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-50c29598-9229-42c6-975f-f912a59826f3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:55.283269 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-50c29598-9229-42c6-975f-f912a59826f3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:55.291043 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-50c29598-9229-42c6-975f-f912a59826f3 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1145 microversion: 2.1 time: 0.085953 Jun 03 15:34:55.291629 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 496/971] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:55 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:55.633240 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c1773e2a-1384-4e40-8886-d5e0913441b7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:55.634635 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c1773e2a-1384-4e40-8886-d5e0913441b7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:55.642369 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1773e2a-1384-4e40-8886-d5e0913441b7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:55.643164 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1773e2a-1384-4e40-8886-d5e0913441b7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:55.644118 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1773e2a-1384-4e40-8886-d5e0913441b7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:55.644557 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1773e2a-1384-4e40-8886-d5e0913441b7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:55.830285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c1773e2a-1384-4e40-8886-d5e0913441b7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:55.838835 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c1773e2a-1384-4e40-8886-d5e0913441b7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.209602 Jun 03 15:34:55.839484 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 476/972] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:55 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:34:56.308937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4553b935-99fc-4268-8488-89cc1ae85977 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:56.309608 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4553b935-99fc-4268-8488-89cc1ae85977 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:56.317852 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4553b935-99fc-4268-8488-89cc1ae85977 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:56.318326 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4553b935-99fc-4268-8488-89cc1ae85977 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:56.319675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4553b935-99fc-4268-8488-89cc1ae85977 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:56.320124 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4553b935-99fc-4268-8488-89cc1ae85977 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:56.386429 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4553b935-99fc-4268-8488-89cc1ae85977 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:56.393858 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4553b935-99fc-4268-8488-89cc1ae85977 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1193 microversion: 2.1 time: 0.089372 Jun 03 15:34:56.394427 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 497/973] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:56 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:56.855223 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c82a7a53-4ff1-47f4-a506-909be9770d7c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:56.855839 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c82a7a53-4ff1-47f4-a506-909be9770d7c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:56.862305 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c82a7a53-4ff1-47f4-a506-909be9770d7c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:56.862783 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c82a7a53-4ff1-47f4-a506-909be9770d7c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:56.863555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c82a7a53-4ff1-47f4-a506-909be9770d7c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:56.863991 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c82a7a53-4ff1-47f4-a506-909be9770d7c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:56.999312 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c82a7a53-4ff1-47f4-a506-909be9770d7c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:57.007472 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c82a7a53-4ff1-47f4-a506-909be9770d7c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.155899 Jun 03 15:34:57.008050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 477/974] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:56 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:57.411143 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d42dcee4-b21a-4201-8710-73f2ba51584e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:57.411782 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d42dcee4-b21a-4201-8710-73f2ba51584e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:57.418354 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d42dcee4-b21a-4201-8710-73f2ba51584e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:57.418901 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d42dcee4-b21a-4201-8710-73f2ba51584e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:57.419671 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d42dcee4-b21a-4201-8710-73f2ba51584e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:57.420104 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d42dcee4-b21a-4201-8710-73f2ba51584e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:57.482684 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d42dcee4-b21a-4201-8710-73f2ba51584e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:57.490671 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d42dcee4-b21a-4201-8710-73f2ba51584e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1193 microversion: 2.1 time: 0.083312 Jun 03 15:34:57.491567 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 498/975] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:57 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:58.025675 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-ec177e68-f4fd-49f3-81d3-b883a5a286af tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:58.026350 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-ec177e68-f4fd-49f3-81d3-b883a5a286af tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:58.033725 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec177e68-f4fd-49f3-81d3-b883a5a286af tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:58.034170 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec177e68-f4fd-49f3-81d3-b883a5a286af tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:58.034959 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec177e68-f4fd-49f3-81d3-b883a5a286af tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:58.035392 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-ec177e68-f4fd-49f3-81d3-b883a5a286af tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:58.167824 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-ec177e68-f4fd-49f3-81d3-b883a5a286af tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:58.176220 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-ec177e68-f4fd-49f3-81d3-b883a5a286af tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.154329 Jun 03 15:34:58.176974 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 478/976] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:58 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:58.512600 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-06f87fb5-4171-42e2-95d0-f9bf5e80aa8a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:58.513289 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-06f87fb5-4171-42e2-95d0-f9bf5e80aa8a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:58.520280 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06f87fb5-4171-42e2-95d0-f9bf5e80aa8a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:58.520726 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06f87fb5-4171-42e2-95d0-f9bf5e80aa8a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:58.521486 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06f87fb5-4171-42e2-95d0-f9bf5e80aa8a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:58.521915 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-06f87fb5-4171-42e2-95d0-f9bf5e80aa8a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:58.583474 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-06f87fb5-4171-42e2-95d0-f9bf5e80aa8a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:58.591084 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-06f87fb5-4171-42e2-95d0-f9bf5e80aa8a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1201 microversion: 2.1 time: 0.085450 Jun 03 15:34:58.591639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 499/977] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:58 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:59.009926 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-681274881", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "networks": [{"uuid": "3678c4cd-eafc-4004-83e0-eba3e6fa12f1"}]}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:34:59.074726 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] validate_networks() for [('3678c4cd-eafc-4004-83e0-eba3e6fa12f1', None, None, None, None, None)] {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:34:59.194458 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-56f2608b-ea5d-4e60-9957-126a21d4b339 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:59.195466 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-56f2608b-ea5d-4e60-9957-126a21d4b339 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:59.201816 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-56f2608b-ea5d-4e60-9957-126a21d4b339 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:59.202279 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-56f2608b-ea5d-4e60-9957-126a21d4b339 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:59.203120 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-56f2608b-ea5d-4e60-9957-126a21d4b339 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:59.203782 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-56f2608b-ea5d-4e60-9957-126a21d4b339 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:59.399753 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-56f2608b-ea5d-4e60-9957-126a21d4b339 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:59.410802 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-56f2608b-ea5d-4e60-9957-126a21d4b339 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.219964 Jun 03 15:34:59.411715 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 500/978] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:59 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:59.615086 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e0d45236-8ec8-4fc9-8982-5df784cf4136 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:59.616816 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e0d45236-8ec8-4fc9-8982-5df784cf4136 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:59.625749 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0d45236-8ec8-4fc9-8982-5df784cf4136 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:59.626436 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0d45236-8ec8-4fc9-8982-5df784cf4136 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:59.627496 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0d45236-8ec8-4fc9-8982-5df784cf4136 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:59.628812 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e0d45236-8ec8-4fc9-8982-5df784cf4136 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:59.695173 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:34:59.695934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:34:59.696439 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:34:59.696861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:34:59.697338 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:34:59.712884 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:59.713872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:59.714802 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:34:59.718851 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:34:59.743274 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e0d45236-8ec8-4fc9-8982-5df784cf4136 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:59.754272 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e0d45236-8ec8-4fc9-8982-5df784cf4136 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1211 microversion: 2.1 time: 0.149664 Jun 03 15:34:59.754927 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 501/979] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:59 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1211 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:34:59.756154 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Getting quotas for project bcb5131601b14b5884956a189e6e9462. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:34:59.761353 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Getting quotas for user 4db856168c34491080b93c8ee5680c2a and project bcb5131601b14b5884956a189e6e9462. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:34:59.776574 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:34:59.779021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:34:59.833493 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a7a7731d-8e6a-46b5-bae7-42665850d54a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827316 Jun 03 15:34:59.834185 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 479/980] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:34:59.848087 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-760a4603-f926-4062-b139-fdff94336cbc tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:34:59.849161 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-760a4603-f926-4062-b139-fdff94336cbc tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:34:59.924756 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-760a4603-f926-4062-b139-fdff94336cbc tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:34:59.931704 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-760a4603-f926-4062-b139-fdff94336cbc tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1213 microversion: 2.1 time: 0.091292 Jun 03 15:34:59.932277 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 502/981] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:34:59 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:00.430837 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5954ed72-c6eb-4067-91e0-a56705f51c00 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:00.432222 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5954ed72-c6eb-4067-91e0-a56705f51c00 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:00.440616 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5954ed72-c6eb-4067-91e0-a56705f51c00 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:00.441349 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5954ed72-c6eb-4067-91e0-a56705f51c00 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:00.442454 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5954ed72-c6eb-4067-91e0-a56705f51c00 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:00.443176 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5954ed72-c6eb-4067-91e0-a56705f51c00 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:00.688147 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5954ed72-c6eb-4067-91e0-a56705f51c00 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:00.698148 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5954ed72-c6eb-4067-91e0-a56705f51c00 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.274236 Jun 03 15:35:00.698760 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 480/982] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:00 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:00.774225 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-fd6ebbd4-e27c-4320-9abc-e259561b487e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:00.775058 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-fd6ebbd4-e27c-4320-9abc-e259561b487e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:00.782392 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fd6ebbd4-e27c-4320-9abc-e259561b487e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:00.782915 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fd6ebbd4-e27c-4320-9abc-e259561b487e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:00.783757 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fd6ebbd4-e27c-4320-9abc-e259561b487e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:00.784121 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fd6ebbd4-e27c-4320-9abc-e259561b487e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:00.952891 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d1dffad1-a0a7-426d-9067-19e5893e9ae1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:00.954393 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d1dffad1-a0a7-426d-9067-19e5893e9ae1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:00.969311 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d1dffad1-a0a7-426d-9067-19e5893e9ae1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:00.970319 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d1dffad1-a0a7-426d-9067-19e5893e9ae1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:00.976826 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d1dffad1-a0a7-426d-9067-19e5893e9ae1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:00.978510 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d1dffad1-a0a7-426d-9067-19e5893e9ae1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:01.197226 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-fd6ebbd4-e27c-4320-9abc-e259561b487e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:01.208451 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-fd6ebbd4-e27c-4320-9abc-e259561b487e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.438370 Jun 03 15:35:01.209382 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 503/983] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:00 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:01.211302 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d1dffad1-a0a7-426d-9067-19e5893e9ae1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:01.226452 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d1dffad1-a0a7-426d-9067-19e5893e9ae1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1283 microversion: 2.1 time: 0.277690 Jun 03 15:35:01.227465 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 481/984] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:00 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1283 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:01.482425 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-54503d00-3caa-4cf8-95bf-ee911e87ede3 req-d06de058-1850-4094-abdb-e4c20250877f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b", "tag": "19ee1e44-f976-459e-a5b3-bb93ee091e6c"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:01.498834 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-54503d00-3caa-4cf8-95bf-ee911e87ede3 req-d06de058-1850-4094-abdb-e4c20250877f service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:01.501241 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-54503d00-3caa-4cf8-95bf-ee911e87ede3 req-d06de058-1850-4094-abdb-e4c20250877f service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:01.539648 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-54503d00-3caa-4cf8-95bf-ee911e87ede3 req-d06de058-1850-4094-abdb-e4c20250877f service nova] Creating event network-changed:19ee1e44-f976-459e-a5b3-bb93ee091e6c for instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b on hv-cinder-83124 Jun 03 15:35:01.548242 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-54503d00-3caa-4cf8-95bf-ee911e87ede3 req-d06de058-1850-4094-abdb-e4c20250877f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069842 Jun 03 15:35:01.549607 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 504/985] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:35:01.716386 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a99d8a1b-5434-4ca6-843c-8ee9aab8d26a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:01.717024 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a99d8a1b-5434-4ca6-843c-8ee9aab8d26a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:01.730304 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a99d8a1b-5434-4ca6-843c-8ee9aab8d26a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:01.731032 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a99d8a1b-5434-4ca6-843c-8ee9aab8d26a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:01.732139 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a99d8a1b-5434-4ca6-843c-8ee9aab8d26a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:01.732790 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a99d8a1b-5434-4ca6-843c-8ee9aab8d26a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:02.033416 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a99d8a1b-5434-4ca6-843c-8ee9aab8d26a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:02.042087 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a99d8a1b-5434-4ca6-843c-8ee9aab8d26a tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.330129 Jun 03 15:35:02.043425 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 482/986] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:01 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:02.228108 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-85cd0f28-7515-40e2-87fe-5a076114625c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:02.229555 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-85cd0f28-7515-40e2-87fe-5a076114625c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:02.241020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-85cd0f28-7515-40e2-87fe-5a076114625c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:02.241770 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-85cd0f28-7515-40e2-87fe-5a076114625c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:02.242784 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-85cd0f28-7515-40e2-87fe-5a076114625c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:02.243422 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-85cd0f28-7515-40e2-87fe-5a076114625c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:02.245796 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a548d085-8c67-4db7-8411-25ade1f2d8dd tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:02.247123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a548d085-8c67-4db7-8411-25ade1f2d8dd tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:02.263441 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a548d085-8c67-4db7-8411-25ade1f2d8dd tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:02.267461 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a548d085-8c67-4db7-8411-25ade1f2d8dd tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:02.268402 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a548d085-8c67-4db7-8411-25ade1f2d8dd tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:02.268865 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a548d085-8c67-4db7-8411-25ade1f2d8dd tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:02.488634 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-85cd0f28-7515-40e2-87fe-5a076114625c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:02.497622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-85cd0f28-7515-40e2-87fe-5a076114625c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.274536 Jun 03 15:35:02.500923 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 505/987] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:02 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:02.591774 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a548d085-8c67-4db7-8411-25ade1f2d8dd tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:02.600850 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a548d085-8c67-4db7-8411-25ade1f2d8dd tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1313 microversion: 2.1 time: 0.360274 Jun 03 15:35:02.614808 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 483/988] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:02 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:03.060331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-17e8eb5b-dcd3-4c73-9266-b4d5dd8ab8a2 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:03.061935 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-17e8eb5b-dcd3-4c73-9266-b4d5dd8ab8a2 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:03.068805 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-17e8eb5b-dcd3-4c73-9266-b4d5dd8ab8a2 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:03.068991 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-17e8eb5b-dcd3-4c73-9266-b4d5dd8ab8a2 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:03.070113 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-17e8eb5b-dcd3-4c73-9266-b4d5dd8ab8a2 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:03.070374 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-17e8eb5b-dcd3-4c73-9266-b4d5dd8ab8a2 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:03.150107 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-60546791-9115-48ec-8d2d-98a3dcfa16b9 req-684ecde7-4236-41d5-bd9c-b35508dc74a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb9d69bb-7d87-4df7-b525-1585a3fcd0d5", "tag": "35aee873-ae42-4009-b76c-8be3dd44183f"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:03.162332 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-60546791-9115-48ec-8d2d-98a3dcfa16b9 req-684ecde7-4236-41d5-bd9c-b35508dc74a4 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:03.163066 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-60546791-9115-48ec-8d2d-98a3dcfa16b9 req-684ecde7-4236-41d5-bd9c-b35508dc74a4 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:03.176243 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-60546791-9115-48ec-8d2d-98a3dcfa16b9 req-684ecde7-4236-41d5-bd9c-b35508dc74a4 service nova] Creating event network-changed:35aee873-ae42-4009-b76c-8be3dd44183f for instance fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 on hv-cinder-83124 Jun 03 15:35:03.182611 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-60546791-9115-48ec-8d2d-98a3dcfa16b9 req-684ecde7-4236-41d5-bd9c-b35508dc74a4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037108 Jun 03 15:35:03.183314 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 484/989] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:35:03.383718 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-6ff5aef3-c72e-4f4d-94ee-6af62a2ef74d req-526e0181-30f8-4375-8c8f-30a414f13b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e324bc-ede1-49c6-b397-7cd7eef8fe4d", "name": "network-vif-plugged", "status": "completed", "tag": "a2683068-e975-44f9-bfbb-088b723434a1"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:03.395769 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-17e8eb5b-dcd3-4c73-9266-b4d5dd8ab8a2 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:03.404892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-6ff5aef3-c72e-4f4d-94ee-6af62a2ef74d req-526e0181-30f8-4375-8c8f-30a414f13b80 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:03.406677 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-17e8eb5b-dcd3-4c73-9266-b4d5dd8ab8a2 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.350486 Jun 03 15:35:03.408554 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-6ff5aef3-c72e-4f4d-94ee-6af62a2ef74d req-526e0181-30f8-4375-8c8f-30a414f13b80 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:03.410617 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 506/990] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:03 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:03.432045 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-6ff5aef3-c72e-4f4d-94ee-6af62a2ef74d req-526e0181-30f8-4375-8c8f-30a414f13b80 service nova] Creating event network-vif-plugged:a2683068-e975-44f9-bfbb-088b723434a1 for instance 73e324bc-ede1-49c6-b397-7cd7eef8fe4d on hv-cinder-83124 Jun 03 15:35:03.439785 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-6ff5aef3-c72e-4f4d-94ee-6af62a2ef74d req-526e0181-30f8-4375-8c8f-30a414f13b80 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071564 Jun 03 15:35:03.440776 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 485/991] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:35:03.520626 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9990d93f-fd66-48dc-b649-9843c1f07200 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:03.521884 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9990d93f-fd66-48dc-b649-9843c1f07200 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:03.538707 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9990d93f-fd66-48dc-b649-9843c1f07200 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:03.540555 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9990d93f-fd66-48dc-b649-9843c1f07200 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:03.542265 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9990d93f-fd66-48dc-b649-9843c1f07200 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:03.543618 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9990d93f-fd66-48dc-b649-9843c1f07200 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:03.631587 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-f6f06846-551b-490d-b3d5-ac8705d68de1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:03.632698 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-f6f06846-551b-490d-b3d5-ac8705d68de1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:03.642786 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f6f06846-551b-490d-b3d5-ac8705d68de1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:03.643732 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f6f06846-551b-490d-b3d5-ac8705d68de1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:03.644774 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f6f06846-551b-490d-b3d5-ac8705d68de1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:03.646231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-f6f06846-551b-490d-b3d5-ac8705d68de1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:03.657067 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:03.861269 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-f6f06846-551b-490d-b3d5-ac8705d68de1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:03.868970 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-f6f06846-551b-490d-b3d5-ac8705d68de1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1313 microversion: 2.1 time: 0.254762 Jun 03 15:35:03.869560 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 486/992] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:03 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:04.250499 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9990d93f-fd66-48dc-b649-9843c1f07200 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:04.257311 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=100 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:04.263130 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9990d93f-fd66-48dc-b649-9843c1f07200 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.748552 Jun 03 15:35:04.264269 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 507/993] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:03 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:04.425101 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9642afc1-6dfe-4e21-bf30-6e1de9cd134b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:04.425802 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9642afc1-6dfe-4e21-bf30-6e1de9cd134b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:04.439647 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9642afc1-6dfe-4e21-bf30-6e1de9cd134b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:04.441463 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9642afc1-6dfe-4e21-bf30-6e1de9cd134b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:04.444936 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9642afc1-6dfe-4e21-bf30-6e1de9cd134b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:04.445667 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9642afc1-6dfe-4e21-bf30-6e1de9cd134b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:04.614585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9642afc1-6dfe-4e21-bf30-6e1de9cd134b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:04.623948 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9642afc1-6dfe-4e21-bf30-6e1de9cd134b tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1318 microversion: 2.1 time: 0.203427 Jun 03 15:35:04.624632 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 487/994] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:04 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:04.894985 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-721469ef-efa2-4369-a6d8-d93d99523fd3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:04.896207 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-721469ef-efa2-4369-a6d8-d93d99523fd3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:04.909120 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-721469ef-efa2-4369-a6d8-d93d99523fd3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:04.909969 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-721469ef-efa2-4369-a6d8-d93d99523fd3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:04.911453 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-721469ef-efa2-4369-a6d8-d93d99523fd3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:04.912205 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-721469ef-efa2-4369-a6d8-d93d99523fd3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:05.107254 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-721469ef-efa2-4369-a6d8-d93d99523fd3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:05.115902 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-721469ef-efa2-4369-a6d8-d93d99523fd3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1313 microversion: 2.1 time: 0.231629 Jun 03 15:35:05.116532 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 508/995] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:04 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:05.284845 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7d601662-c480-4577-9355-61c28a04372a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:05.286250 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7d601662-c480-4577-9355-61c28a04372a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:05.301072 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7d601662-c480-4577-9355-61c28a04372a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:05.301872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7d601662-c480-4577-9355-61c28a04372a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:05.303509 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7d601662-c480-4577-9355-61c28a04372a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:05.304233 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7d601662-c480-4577-9355-61c28a04372a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:05.600049 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7d601662-c480-4577-9355-61c28a04372a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:05.613557 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7d601662-c480-4577-9355-61c28a04372a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.335573 Jun 03 15:35:05.614758 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 488/996] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:05 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:05.645930 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-886e0ad5-73dd-42a1-868b-d76aca486482 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:05.646298 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-886e0ad5-73dd-42a1-868b-d76aca486482 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:05.663437 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-886e0ad5-73dd-42a1-868b-d76aca486482 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:05.663912 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-886e0ad5-73dd-42a1-868b-d76aca486482 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:05.664656 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-886e0ad5-73dd-42a1-868b-d76aca486482 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:05.665111 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-886e0ad5-73dd-42a1-868b-d76aca486482 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:05.883536 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-886e0ad5-73dd-42a1-868b-d76aca486482 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:05.904821 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-886e0ad5-73dd-42a1-868b-d76aca486482 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1507 microversion: 2.1 time: 0.265963 Jun 03 15:35:05.906169 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 509/997] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:05 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:05.941033 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-30ffcd5c-14f8-4b8c-ba9e-45571483ad89 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6931e41-e403-4d7b-ac81-fe4c2ddd0735", "device": "/dev/sdb"}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:05.944754 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-30ffcd5c-14f8-4b8c-ba9e-45571483ad89 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:05.981572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-30ffcd5c-14f8-4b8c-ba9e-45571483ad89 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:05.982755 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-30ffcd5c-14f8-4b8c-ba9e-45571483ad89 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:05.984955 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-30ffcd5c-14f8-4b8c-ba9e-45571483ad89 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:05.985919 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-30ffcd5c-14f8-4b8c-ba9e-45571483ad89 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:06.137710 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-47c41259-cb0f-4e81-830b-07ea8b531f97 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:06.139389 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-47c41259-cb0f-4e81-830b-07ea8b531f97 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:06.165983 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-47c41259-cb0f-4e81-830b-07ea8b531f97 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:06.167675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-47c41259-cb0f-4e81-830b-07ea8b531f97 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:06.169524 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-47c41259-cb0f-4e81-830b-07ea8b531f97 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:06.171264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-47c41259-cb0f-4e81-830b-07ea8b531f97 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:06.386193 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-30ffcd5c-14f8-4b8c-ba9e-45571483ad89 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "POST /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467319 Jun 03 15:35:06.393236 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 489/998] 10.222.0.93 () {60 vars in 1322 bytes} [Fri Jun 3 15:35:05 2022] POST /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:35:06.493589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-47c41259-cb0f-4e81-830b-07ea8b531f97 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:06.511076 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-47c41259-cb0f-4e81-830b-07ea8b531f97 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1313 microversion: 2.1 time: 0.380852 Jun 03 15:35:06.511661 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 510/999] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:06 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:06.633160 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b89998e7-2762-4928-9dec-749fda12f8d5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:06.633816 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b89998e7-2762-4928-9dec-749fda12f8d5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:06.641716 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b89998e7-2762-4928-9dec-749fda12f8d5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:06.642424 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b89998e7-2762-4928-9dec-749fda12f8d5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:06.643275 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b89998e7-2762-4928-9dec-749fda12f8d5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:06.643725 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b89998e7-2762-4928-9dec-749fda12f8d5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:06.809295 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b89998e7-2762-4928-9dec-749fda12f8d5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:06.818879 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b89998e7-2762-4928-9dec-749fda12f8d5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.190370 Jun 03 15:35:06.819652 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 490/1000] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:06 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:07.535210 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-51901480-965f-4b69-bfff-c259c9136a73 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:07.536878 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-51901480-965f-4b69-bfff-c259c9136a73 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:07.546837 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-51901480-965f-4b69-bfff-c259c9136a73 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:07.547574 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-51901480-965f-4b69-bfff-c259c9136a73 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:07.548803 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-51901480-965f-4b69-bfff-c259c9136a73 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:07.549793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-51901480-965f-4b69-bfff-c259c9136a73 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:07.706464 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-51901480-965f-4b69-bfff-c259c9136a73 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:07.726743 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-51901480-965f-4b69-bfff-c259c9136a73 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1313 microversion: 2.1 time: 0.199788 Jun 03 15:35:07.744748 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 511/1001] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:07 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:07.844885 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b5ad9f35-abf6-46a4-8dc6-2e4f1ad2555c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:07.846358 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b5ad9f35-abf6-46a4-8dc6-2e4f1ad2555c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:07.855639 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b5ad9f35-abf6-46a4-8dc6-2e4f1ad2555c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:07.856507 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b5ad9f35-abf6-46a4-8dc6-2e4f1ad2555c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:07.857282 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b5ad9f35-abf6-46a4-8dc6-2e4f1ad2555c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:07.858009 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b5ad9f35-abf6-46a4-8dc6-2e4f1ad2555c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:08.047805 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b5ad9f35-abf6-46a4-8dc6-2e4f1ad2555c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:08.055441 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b5ad9f35-abf6-46a4-8dc6-2e4f1ad2555c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.220828 Jun 03 15:35:08.056087 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 491/1002] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:07 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:08.752986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-dc17e1b1-6319-4ac3-a6f7-c1eb198581ea tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:08.753596 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-dc17e1b1-6319-4ac3-a6f7-c1eb198581ea tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:08.760453 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc17e1b1-6319-4ac3-a6f7-c1eb198581ea tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:08.761165 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc17e1b1-6319-4ac3-a6f7-c1eb198581ea tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:08.761980 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc17e1b1-6319-4ac3-a6f7-c1eb198581ea tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:08.762411 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc17e1b1-6319-4ac3-a6f7-c1eb198581ea tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:08.900826 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-dc17e1b1-6319-4ac3-a6f7-c1eb198581ea tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:08.912037 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-dc17e1b1-6319-4ac3-a6f7-c1eb198581ea tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1313 microversion: 2.1 time: 0.163349 Jun 03 15:35:08.912545 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 512/1003] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:08 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:09.073082 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-4a82f36e-9dcd-45a6-88df-fc50ea428cb2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:09.074011 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-4a82f36e-9dcd-45a6-88df-fc50ea428cb2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:09.078107 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:09.082924 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4a82f36e-9dcd-45a6-88df-fc50ea428cb2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:09.082924 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4a82f36e-9dcd-45a6-88df-fc50ea428cb2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:09.082924 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4a82f36e-9dcd-45a6-88df-fc50ea428cb2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:09.083519 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-4a82f36e-9dcd-45a6-88df-fc50ea428cb2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:09.297203 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-4a82f36e-9dcd-45a6-88df-fc50ea428cb2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:09.305902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-4a82f36e-9dcd-45a6-88df-fc50ea428cb2 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.236756 Jun 03 15:35:09.307226 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 492/1004] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:09 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:09.573656 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-67b7eca4-66bd-4e9f-b7c7-ffd86495e1ed req-0e58d971-3a26-478a-ac70-c9328c2ab1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9d69bb-7d87-4df7-b525-1585a3fcd0d5", "name": "network-vif-plugged", "status": "completed", "tag": "35aee873-ae42-4009-b76c-8be3dd44183f"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:09.589397 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-67b7eca4-66bd-4e9f-b7c7-ffd86495e1ed req-0e58d971-3a26-478a-ac70-c9328c2ab1d0 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:09.590231 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-67b7eca4-66bd-4e9f-b7c7-ffd86495e1ed req-0e58d971-3a26-478a-ac70-c9328c2ab1d0 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:09.608049 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-67b7eca4-66bd-4e9f-b7c7-ffd86495e1ed req-0e58d971-3a26-478a-ac70-c9328c2ab1d0 service nova] Creating event network-vif-plugged:35aee873-ae42-4009-b76c-8be3dd44183f for instance fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 on hv-cinder-83124 Jun 03 15:35:09.615746 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-67b7eca4-66bd-4e9f-b7c7-ffd86495e1ed req-0e58d971-3a26-478a-ac70-c9328c2ab1d0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047982 Jun 03 15:35:09.616694 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 513/1005] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:35:09.929181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-03a7c02f-f06d-4113-9be1-e6e1257c5d95 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:09.929949 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-03a7c02f-f06d-4113-9be1-e6e1257c5d95 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:09.931997 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=6 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:09.932669 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=18 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:09.939758 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-03a7c02f-f06d-4113-9be1-e6e1257c5d95 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:09.940413 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-03a7c02f-f06d-4113-9be1-e6e1257c5d95 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:09.941213 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-03a7c02f-f06d-4113-9be1-e6e1257c5d95 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:09.941655 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-03a7c02f-f06d-4113-9be1-e6e1257c5d95 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:10.105270 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-03a7c02f-f06d-4113-9be1-e6e1257c5d95 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:10.117110 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-03a7c02f-f06d-4113-9be1-e6e1257c5d95 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1313 microversion: 2.1 time: 0.191737 Jun 03 15:35:10.118445 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 493/1006] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:09 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:10.322945 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-cf9c6eec-3d66-4f63-a16b-577f3acb217e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:10.323791 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-cf9c6eec-3d66-4f63-a16b-577f3acb217e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:10.326475 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=6 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:10.332525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cf9c6eec-3d66-4f63-a16b-577f3acb217e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:10.332985 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cf9c6eec-3d66-4f63-a16b-577f3acb217e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:10.333764 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cf9c6eec-3d66-4f63-a16b-577f3acb217e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:10.334230 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-cf9c6eec-3d66-4f63-a16b-577f3acb217e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:10.496451 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-cf9c6eec-3d66-4f63-a16b-577f3acb217e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:10.504882 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-cf9c6eec-3d66-4f63-a16b-577f3acb217e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.186249 Jun 03 15:35:10.505795 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 514/1007] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:10 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:11.134932 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-95bb52f8-e6d5-42cf-a74f-19f2314464a9 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:11.135547 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-95bb52f8-e6d5-42cf-a74f-19f2314464a9 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:11.144462 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-95bb52f8-e6d5-42cf-a74f-19f2314464a9 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:11.144913 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-95bb52f8-e6d5-42cf-a74f-19f2314464a9 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:11.145687 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-95bb52f8-e6d5-42cf-a74f-19f2314464a9 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:11.146123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-95bb52f8-e6d5-42cf-a74f-19f2314464a9 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:11.341130 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-95bb52f8-e6d5-42cf-a74f-19f2314464a9 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:11.352699 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-95bb52f8-e6d5-42cf-a74f-19f2314464a9 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1313 microversion: 2.1 time: 0.221759 Jun 03 15:35:11.353515 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 494/1008] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:11 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:11.521881 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-6d21ec6d-6570-4af1-b498-7c9aeaa93a31 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:11.522732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-6d21ec6d-6570-4af1-b498-7c9aeaa93a31 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:11.534465 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6d21ec6d-6570-4af1-b498-7c9aeaa93a31 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:11.534956 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6d21ec6d-6570-4af1-b498-7c9aeaa93a31 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:11.535735 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6d21ec6d-6570-4af1-b498-7c9aeaa93a31 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:11.536178 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-6d21ec6d-6570-4af1-b498-7c9aeaa93a31 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:11.648621 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-c057a80f-22dc-45b8-9902-ea62b5c49f56 req-512a1a65-7ab8-45f0-aa43-1472b8c29c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b", "name": "network-vif-plugged", "status": "completed", "tag": "19ee1e44-f976-459e-a5b3-bb93ee091e6c"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:11.707717 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-6d21ec6d-6570-4af1-b498-7c9aeaa93a31 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:11.719692 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-c057a80f-22dc-45b8-9902-ea62b5c49f56 req-512a1a65-7ab8-45f0-aa43-1472b8c29c7a service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:11.720328 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-c057a80f-22dc-45b8-9902-ea62b5c49f56 req-512a1a65-7ab8-45f0-aa43-1472b8c29c7a service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:11.720507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-6d21ec6d-6570-4af1-b498-7c9aeaa93a31 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.201715 Jun 03 15:35:11.721520 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 515/1009] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:11 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:11.739441 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-c057a80f-22dc-45b8-9902-ea62b5c49f56 req-512a1a65-7ab8-45f0-aa43-1472b8c29c7a service nova] Creating event network-vif-plugged:19ee1e44-f976-459e-a5b3-bb93ee091e6c for instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b on hv-cinder-83124 Jun 03 15:35:11.746058 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-c057a80f-22dc-45b8-9902-ea62b5c49f56 req-512a1a65-7ab8-45f0-aa43-1472b8c29c7a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103515 Jun 03 15:35:11.746872 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 495/1010] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:35:12.371737 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f5fa34cc-fcb7-4270-8464-95109be585a0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:12.372358 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f5fa34cc-fcb7-4270-8464-95109be585a0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:12.385695 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5fa34cc-fcb7-4270-8464-95109be585a0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:12.386962 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5fa34cc-fcb7-4270-8464-95109be585a0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:12.388531 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5fa34cc-fcb7-4270-8464-95109be585a0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:12.390569 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5fa34cc-fcb7-4270-8464-95109be585a0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:12.601153 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f5fa34cc-fcb7-4270-8464-95109be585a0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:12.609439 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f5fa34cc-fcb7-4270-8464-95109be585a0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1496 microversion: 2.1 time: 0.241921 Jun 03 15:35:12.610101 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 516/1011] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:12 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1496 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:12.745321 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c1c725f7-0fd2-48c5-b18c-de33c2711b9c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:12.747000 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c1c725f7-0fd2-48c5-b18c-de33c2711b9c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:12.757729 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1c725f7-0fd2-48c5-b18c-de33c2711b9c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:12.758473 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1c725f7-0fd2-48c5-b18c-de33c2711b9c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:12.759578 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1c725f7-0fd2-48c5-b18c-de33c2711b9c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:12.760059 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c1c725f7-0fd2-48c5-b18c-de33c2711b9c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:12.976558 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-c1c725f7-0fd2-48c5-b18c-de33c2711b9c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:12.984133 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c1c725f7-0fd2-48c5-b18c-de33c2711b9c tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.244408 Jun 03 15:35:12.984699 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 496/1012] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:12 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:13.148381 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-3e04c8f2-45c1-4a1f-96fd-e5034aab0c0b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:13.148724 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3e04c8f2-45c1-4a1f-96fd-e5034aab0c0b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:13.156978 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3e04c8f2-45c1-4a1f-96fd-e5034aab0c0b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:13.157573 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3e04c8f2-45c1-4a1f-96fd-e5034aab0c0b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:13.158451 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3e04c8f2-45c1-4a1f-96fd-e5034aab0c0b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:13.158979 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-3e04c8f2-45c1-4a1f-96fd-e5034aab0c0b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:13.187267 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-3e04c8f2-45c1-4a1f-96fd-e5034aab0c0b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Going to try to terminate instance {{(pid=117806) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:35:13.286864 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-3e04c8f2-45c1-4a1f-96fd-e5034aab0c0b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 204 len: 0 microversion: 2.1 time: 0.142946 Jun 03 15:35:13.287713 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 517/1013] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:35:13 2022] DELETE /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:35:13.297860 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1ff5dd69-a446-474b-88b1-5badb5b9d293 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:13.298500 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1ff5dd69-a446-474b-88b1-5badb5b9d293 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:13.304889 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1ff5dd69-a446-474b-88b1-5badb5b9d293 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:13.305252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1ff5dd69-a446-474b-88b1-5badb5b9d293 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:13.306021 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1ff5dd69-a446-474b-88b1-5badb5b9d293 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:13.306461 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1ff5dd69-a446-474b-88b1-5badb5b9d293 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:13.481150 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-1ff5dd69-a446-474b-88b1-5badb5b9d293 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:13.490303 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1ff5dd69-a446-474b-88b1-5badb5b9d293 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1502 microversion: 2.1 time: 0.197070 Jun 03 15:35:13.490953 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 497/1014] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:13 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:14.004026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9138a703-fb3d-4aa3-a5ea-cdd797d0c3dc tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:14.004821 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9138a703-fb3d-4aa3-a5ea-cdd797d0c3dc tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:14.013545 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9138a703-fb3d-4aa3-a5ea-cdd797d0c3dc tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:14.014416 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9138a703-fb3d-4aa3-a5ea-cdd797d0c3dc tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:14.015405 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9138a703-fb3d-4aa3-a5ea-cdd797d0c3dc tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:14.016012 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9138a703-fb3d-4aa3-a5ea-cdd797d0c3dc tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:14.187949 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9138a703-fb3d-4aa3-a5ea-cdd797d0c3dc tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:14.195882 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9138a703-fb3d-4aa3-a5ea-cdd797d0c3dc tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.196880 Jun 03 15:35:14.196454 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 518/1015] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:13 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:14.508392 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-db8dac0e-b9e6-4478-ad94-f3b91113a75c tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:14.509170 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-db8dac0e-b9e6-4478-ad94-f3b91113a75c tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:14.517478 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-db8dac0e-b9e6-4478-ad94-f3b91113a75c tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:14.517994 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-db8dac0e-b9e6-4478-ad94-f3b91113a75c tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:14.519368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-db8dac0e-b9e6-4478-ad94-f3b91113a75c tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:14.520484 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-db8dac0e-b9e6-4478-ad94-f3b91113a75c tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:14.666050 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-db8dac0e-b9e6-4478-ad94-f3b91113a75c tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:14.679934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-db8dac0e-b9e6-4478-ad94-f3b91113a75c tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1502 microversion: 2.1 time: 0.175730 Jun 03 15:35:14.680519 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 498/1016] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:14 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:15.213187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9c8b16c5-bc99-4fd4-bc73-dec8a43df5e8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:15.213835 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9c8b16c5-bc99-4fd4-bc73-dec8a43df5e8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:15.220999 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c8b16c5-bc99-4fd4-bc73-dec8a43df5e8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:15.221439 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c8b16c5-bc99-4fd4-bc73-dec8a43df5e8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:15.222203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c8b16c5-bc99-4fd4-bc73-dec8a43df5e8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:15.222675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9c8b16c5-bc99-4fd4-bc73-dec8a43df5e8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:15.364452 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-9c8b16c5-bc99-4fd4-bc73-dec8a43df5e8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:15.372176 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9c8b16c5-bc99-4fd4-bc73-dec8a43df5e8 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.163146 Jun 03 15:35:15.372751 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 519/1017] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:15 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:15.697917 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-2f98622a-fbf7-466a-960f-7ad38d6f9b58 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:15.698814 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-2f98622a-fbf7-466a-960f-7ad38d6f9b58 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:15.705643 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2f98622a-fbf7-466a-960f-7ad38d6f9b58 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:15.706091 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2f98622a-fbf7-466a-960f-7ad38d6f9b58 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:15.706880 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2f98622a-fbf7-466a-960f-7ad38d6f9b58 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:15.707313 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-2f98622a-fbf7-466a-960f-7ad38d6f9b58 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:15.880724 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-2f98622a-fbf7-466a-960f-7ad38d6f9b58 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:15.889272 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-2f98622a-fbf7-466a-960f-7ad38d6f9b58 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1502 microversion: 2.1 time: 0.195310 Jun 03 15:35:15.889848 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 499/1018] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:15 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:16.396732 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f38dbb21-4505-43fe-9da9-830f816ff770 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:16.397725 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f38dbb21-4505-43fe-9da9-830f816ff770 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:16.406590 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f38dbb21-4505-43fe-9da9-830f816ff770 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:16.407311 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f38dbb21-4505-43fe-9da9-830f816ff770 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:16.408389 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f38dbb21-4505-43fe-9da9-830f816ff770 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:16.408951 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f38dbb21-4505-43fe-9da9-830f816ff770 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:16.572663 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f38dbb21-4505-43fe-9da9-830f816ff770 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:16.588804 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f38dbb21-4505-43fe-9da9-830f816ff770 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.197496 Jun 03 15:35:16.589380 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 520/1019] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:16 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:16.920150 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e664ce88-294d-4956-b663-c53c5c60ea5e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:16.921380 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e664ce88-294d-4956-b663-c53c5c60ea5e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:16.927952 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e664ce88-294d-4956-b663-c53c5c60ea5e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:16.928588 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e664ce88-294d-4956-b663-c53c5c60ea5e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:16.929614 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e664ce88-294d-4956-b663-c53c5c60ea5e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:16.930178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e664ce88-294d-4956-b663-c53c5c60ea5e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:17.078515 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-e664ce88-294d-4956-b663-c53c5c60ea5e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:17.086285 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e664ce88-294d-4956-b663-c53c5c60ea5e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1502 microversion: 2.1 time: 0.171485 Jun 03 15:35:17.086990 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 500/1020] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:16 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:17.615628 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0bdfb803-5814-448d-b8ab-d84f9ecad64f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:17.616390 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0bdfb803-5814-448d-b8ab-d84f9ecad64f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:17.620614 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:17.624837 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0bdfb803-5814-448d-b8ab-d84f9ecad64f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:17.625283 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0bdfb803-5814-448d-b8ab-d84f9ecad64f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:17.626053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0bdfb803-5814-448d-b8ab-d84f9ecad64f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:17.626481 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0bdfb803-5814-448d-b8ab-d84f9ecad64f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:17.794960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0bdfb803-5814-448d-b8ab-d84f9ecad64f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:17.808654 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0bdfb803-5814-448d-b8ab-d84f9ecad64f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1266 microversion: 2.1 time: 0.199674 Jun 03 15:35:17.809816 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 521/1021] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:17 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:18.105966 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b0331cb2-7b76-4cfc-a22f-c131604680b1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:18.106436 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b0331cb2-7b76-4cfc-a22f-c131604680b1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:18.113381 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b0331cb2-7b76-4cfc-a22f-c131604680b1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:18.113831 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b0331cb2-7b76-4cfc-a22f-c131604680b1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:18.114782 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b0331cb2-7b76-4cfc-a22f-c131604680b1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:18.115220 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b0331cb2-7b76-4cfc-a22f-c131604680b1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:18.276428 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b0331cb2-7b76-4cfc-a22f-c131604680b1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:18.285372 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b0331cb2-7b76-4cfc-a22f-c131604680b1 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1502 microversion: 2.1 time: 0.184741 Jun 03 15:35:18.285980 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 501/1022] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:18 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:18.829841 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-eeefc095-84a7-45a9-b7ac-e8864bd25344 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:18.831394 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-eeefc095-84a7-45a9-b7ac-e8864bd25344 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:18.843270 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-eeefc095-84a7-45a9-b7ac-e8864bd25344 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:18.843731 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-eeefc095-84a7-45a9-b7ac-e8864bd25344 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:18.844514 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-eeefc095-84a7-45a9-b7ac-e8864bd25344 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:18.844949 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-eeefc095-84a7-45a9-b7ac-e8864bd25344 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:19.018876 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-eeefc095-84a7-45a9-b7ac-e8864bd25344 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:19.031696 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-eeefc095-84a7-45a9-b7ac-e8864bd25344 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1454 microversion: 2.1 time: 0.209362 Jun 03 15:35:19.044146 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 522/1023] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:18 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1454 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:19.057316 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-071e75ad-fb62-4d42-a215-2222c962301e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:19.058398 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-071e75ad-fb62-4d42-a215-2222c962301e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:19.068654 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-071e75ad-fb62-4d42-a215-2222c962301e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:19.069658 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-071e75ad-fb62-4d42-a215-2222c962301e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:19.071583 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-071e75ad-fb62-4d42-a215-2222c962301e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:19.072498 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-071e75ad-fb62-4d42-a215-2222c962301e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:19.106762 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:19.276742 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-071e75ad-fb62-4d42-a215-2222c962301e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:19.287777 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-071e75ad-fb62-4d42-a215-2222c962301e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1454 microversion: 2.1 time: 0.242513 Jun 03 15:35:19.288392 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 502/1024] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:19 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1454 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:19.305800 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-23b2cbe6-17f5-47a2-829f-b0b1ba4144cf tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:19.306750 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-23b2cbe6-17f5-47a2-829f-b0b1ba4144cf tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:19.313416 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23b2cbe6-17f5-47a2-829f-b0b1ba4144cf tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:19.314103 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23b2cbe6-17f5-47a2-829f-b0b1ba4144cf tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:19.314926 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23b2cbe6-17f5-47a2-829f-b0b1ba4144cf tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:19.315660 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-23b2cbe6-17f5-47a2-829f-b0b1ba4144cf tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:19.336244 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:19.487040 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-23b2cbe6-17f5-47a2-829f-b0b1ba4144cf tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:19.495016 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-23b2cbe6-17f5-47a2-829f-b0b1ba4144cf tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1502 microversion: 2.1 time: 0.195741 Jun 03 15:35:19.495662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 523/1025] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:19 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:20.271661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-99aaeef2-1b18-4e8c-bb9a-c0dedb071793 req-61e5bc6b-bab2-4189-b7bd-2f02eac263cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9d69bb-7d87-4df7-b525-1585a3fcd0d5", "name": "network-vif-deleted", "tag": "35aee873-ae42-4009-b76c-8be3dd44183f"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:20.281817 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-99aaeef2-1b18-4e8c-bb9a-c0dedb071793 req-61e5bc6b-bab2-4189-b7bd-2f02eac263cb service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:20.282238 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-99aaeef2-1b18-4e8c-bb9a-c0dedb071793 req-61e5bc6b-bab2-4189-b7bd-2f02eac263cb service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:20.300807 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-99aaeef2-1b18-4e8c-bb9a-c0dedb071793 req-61e5bc6b-bab2-4189-b7bd-2f02eac263cb service nova] Creating event network-vif-deleted:35aee873-ae42-4009-b76c-8be3dd44183f for instance fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 on hv-cinder-83124 Jun 03 15:35:20.308682 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-99aaeef2-1b18-4e8c-bb9a-c0dedb071793 req-61e5bc6b-bab2-4189-b7bd-2f02eac263cb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040740 Jun 03 15:35:20.309293 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 503/1026] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:35:20.513818 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-dd5c040a-5340-4b08-a34b-7d10272982fb tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:20.515505 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-dd5c040a-5340-4b08-a34b-7d10272982fb tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:20.529669 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dd5c040a-5340-4b08-a34b-7d10272982fb tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:20.530703 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dd5c040a-5340-4b08-a34b-7d10272982fb tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:20.531711 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dd5c040a-5340-4b08-a34b-7d10272982fb tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:20.532319 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dd5c040a-5340-4b08-a34b-7d10272982fb tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:20.628046 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-dd5c040a-5340-4b08-a34b-7d10272982fb tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:20.637369 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-dd5c040a-5340-4b08-a34b-7d10272982fb tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1460 microversion: 2.1 time: 0.127493 Jun 03 15:35:20.639014 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 524/1027] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:20 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1460 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:21.199789 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-f6e99261-7891-4b3f-b773-f46f3e713d86 req-09cf7424-2738-4881-83af-80fdff75c256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b", "tag": "19ee1e44-f976-459e-a5b3-bb93ee091e6c"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:21.209417 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-f6e99261-7891-4b3f-b773-f46f3e713d86 req-09cf7424-2738-4881-83af-80fdff75c256 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:21.209952 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-f6e99261-7891-4b3f-b773-f46f3e713d86 req-09cf7424-2738-4881-83af-80fdff75c256 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:21.223440 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-f6e99261-7891-4b3f-b773-f46f3e713d86 req-09cf7424-2738-4881-83af-80fdff75c256 service nova] Creating event network-changed:19ee1e44-f976-459e-a5b3-bb93ee091e6c for instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b on hv-cinder-83124 Jun 03 15:35:21.237775 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-f6e99261-7891-4b3f-b773-f46f3e713d86 req-09cf7424-2738-4881-83af-80fdff75c256 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042233 Jun 03 15:35:21.238759 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 504/1028] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:35:21.675690 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-45ccf3ff-6f24-495a-a5c8-b4412bc860d4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:21.676294 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-45ccf3ff-6f24-495a-a5c8-b4412bc860d4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:21.688187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-45ccf3ff-6f24-495a-a5c8-b4412bc860d4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:21.688644 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-45ccf3ff-6f24-495a-a5c8-b4412bc860d4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:21.689523 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-45ccf3ff-6f24-495a-a5c8-b4412bc860d4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:21.689955 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-45ccf3ff-6f24-495a-a5c8-b4412bc860d4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:21.789790 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-45ccf3ff-6f24-495a-a5c8-b4412bc860d4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:21.799399 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-45ccf3ff-6f24-495a-a5c8-b4412bc860d4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 200 len: 1298 microversion: 2.1 time: 0.138892 Jun 03 15:35:21.800072 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 525/1029] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:21 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 1298 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:22.821086 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-25db15ff-7311-428f-8026-6715b4db427f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:22.821934 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-25db15ff-7311-428f-8026-6715b4db427f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: fb9d69bb-7d87-4df7-b525-1585a3fcd0d5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:22.828350 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-25db15ff-7311-428f-8026-6715b4db427f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:22.828893 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-25db15ff-7311-428f-8026-6715b4db427f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:22.829751 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-25db15ff-7311-428f-8026-6715b4db427f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:22.830275 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-25db15ff-7311-428f-8026-6715b4db427f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:22.845542 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-25db15ff-7311-428f-8026-6715b4db427f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] HTTP exception thrown: Instance fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 could not be found. Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-25db15ff-7311-428f-8026-6715b4db427f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Request method failure captured: Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 HTTP/1.1 Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimiocVKNZIa8NyUCEAvH8yPEov4pGMBrTz6pRKvOQRsAlBEBBeYlQhGQkAenv0IjJlxSbvrgvJLsT-aMTIrQLx394FBxYuVN5CWSoAVHBbf70rSSxUK1slqpU-M_agW-bVGJLnDgSUZ8NeaOAMIhVKctHfF5eMyEwnrUricCdnESXUso Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: bcb5131601b14b5884956a189e6e9462 Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-VolumesActionsTest-1331699078 Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:35:22.847231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bcb5131601b14b5884956a189e6e9462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bcb5131601b14b5884956a189e6e9462"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_bcb5131601b14b5884956a189e6e9462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/bcb5131601b14b5884956a189e6e9462"}]}] Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-VolumesActionsTest-1331699078 Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: bcb5131601b14b5884956a189e6e9462 Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-VolumesActionsTest-1331699078 Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-VolumesActionsTest-1331699078-project Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 4db856168c34491080b93c8ee5680c2a Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-VolumesActionsTest-1331699078-project Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 could not be found. Jun 03 15:35:22.849861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': 'fb9d69bb-7d87-4df7-b525-1585a3fcd0d5'} Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 could not be found. Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:35:22.851738 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 could not be found. Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 could not be found. Jun 03 15:35:22.854572 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:22.856837 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-25db15ff-7311-428f-8026-6715b4db427f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Returning 404 to user: Instance fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:35:22.856837 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-25db15ff-7311-428f-8026-6715b4db427f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5" status: 404 len: 111 microversion: 2.1 time: 0.032630 Jun 03 15:35:22.856837 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 505/1030] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:22 2022] GET /compute/v2.1/servers/fb9d69bb-7d87-4df7-b525-1585a3fcd0d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:35:22.957960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2105193123", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452", "networks": [{"uuid": "3678c4cd-eafc-4004-83e0-eba3e6fa12f1"}]}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:23.013383 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.network.neutron [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] validate_networks() for [('3678c4cd-eafc-4004-83e0-eba3e6fa12f1', None, None, None, None, None)] {{(pid=117806) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:35:23.490312 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Flavor limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:35:23.490775 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Image limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:35:23.491254 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Flavor pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:35:23.491668 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Image pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:35:23.492083 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:35:23.501457 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:23.501899 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:23.502822 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:23.503266 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:23.521225 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Getting quotas for project bcb5131601b14b5884956a189e6e9462. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:35:23.525223 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Getting quotas for user 4db856168c34491080b93c8ee5680c2a and project bcb5131601b14b5884956a189e6e9462. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:35:23.539136 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Going to run 1 instances... {{(pid=117806) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:35:23.541439 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:35:23.592068 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-55a8b20e-a835-434d-8d95-808d7a7da344 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638220 Jun 03 15:35:23.593296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 526/1031] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:35:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 15:35:23.603483 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a8033095-c59e-4b11-bd37-899f84a68279 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:23.604582 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a8033095-c59e-4b11-bd37-899f84a68279 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:23.664621 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a8033095-c59e-4b11-bd37-899f84a68279 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:23.672477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a8033095-c59e-4b11-bd37-899f84a68279 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1214 microversion: 2.1 time: 0.072907 Jun 03 15:35:23.673365 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 506/1032] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:23 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:24.689907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-fc774e70-4a8c-48b6-99af-2fdef3c6848e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:24.690526 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-fc774e70-4a8c-48b6-99af-2fdef3c6848e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:24.697432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fc774e70-4a8c-48b6-99af-2fdef3c6848e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:24.697887 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fc774e70-4a8c-48b6-99af-2fdef3c6848e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:24.698681 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fc774e70-4a8c-48b6-99af-2fdef3c6848e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:24.699128 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-fc774e70-4a8c-48b6-99af-2fdef3c6848e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:24.765534 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-fc774e70-4a8c-48b6-99af-2fdef3c6848e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:24.773486 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-fc774e70-4a8c-48b6-99af-2fdef3c6848e tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1266 microversion: 2.1 time: 0.088066 Jun 03 15:35:24.774062 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 527/1033] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:24 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:25.791333 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7941df80-d04d-4d75-ab68-3ceaeb8d9d69 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:25.791958 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7941df80-d04d-4d75-ab68-3ceaeb8d9d69 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:25.802103 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7941df80-d04d-4d75-ab68-3ceaeb8d9d69 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:25.802571 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7941df80-d04d-4d75-ab68-3ceaeb8d9d69 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:25.803351 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7941df80-d04d-4d75-ab68-3ceaeb8d9d69 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:25.803784 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7941df80-d04d-4d75-ab68-3ceaeb8d9d69 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:25.943879 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7941df80-d04d-4d75-ab68-3ceaeb8d9d69 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:25.952493 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7941df80-d04d-4d75-ab68-3ceaeb8d9d69 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1314 microversion: 2.1 time: 0.164681 Jun 03 15:35:25.953076 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 507/1034] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:25 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:26.142874 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-16d07798-16d1-414a-a7bf-9846333d1319 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:26.144174 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-16d07798-16d1-414a-a7bf-9846333d1319 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:26.153986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-16d07798-16d1-414a-a7bf-9846333d1319 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:26.154665 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-16d07798-16d1-414a-a7bf-9846333d1319 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:26.156438 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-16d07798-16d1-414a-a7bf-9846333d1319 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:26.157190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-16d07798-16d1-414a-a7bf-9846333d1319 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:26.273519 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-16d07798-16d1-414a-a7bf-9846333d1319 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lazy-loading 'services' on Instance uuid 73e324bc-ede1-49c6-b397-7cd7eef8fe4d {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:35:26.369794 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-16d07798-16d1-414a-a7bf-9846333d1319 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "DELETE /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d/os-volume_attachments/b6931e41-e403-4d7b-ac81-fe4c2ddd0735" status: 202 len: 0 microversion: 2.1 time: 0.235258 Jun 03 15:35:26.370389 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 528/1035] 10.222.0.93 () {58 vars in 1415 bytes} [Fri Jun 3 15:35:26 2022] DELETE /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d/os-volume_attachments/b6931e41-e403-4d7b-ac81-fe4c2ddd0735 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 15:35:26.484354 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-33e30820-d5cb-4309-8c9b-a15d0e6089ae req-af4fe6e9-8bf6-47b9-a8ae-64e05a472387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f349a02-689d-4a1e-ba9a-2ca47b0347a3", "tag": "5ac0e121-8695-4bc9-bd81-da3b65bd09aa"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:26.501475 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-33e30820-d5cb-4309-8c9b-a15d0e6089ae req-af4fe6e9-8bf6-47b9-a8ae-64e05a472387 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:26.502067 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-33e30820-d5cb-4309-8c9b-a15d0e6089ae req-af4fe6e9-8bf6-47b9-a8ae-64e05a472387 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:26.515965 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-33e30820-d5cb-4309-8c9b-a15d0e6089ae req-af4fe6e9-8bf6-47b9-a8ae-64e05a472387 service nova] Creating event network-changed:5ac0e121-8695-4bc9-bd81-da3b65bd09aa for instance 8f349a02-689d-4a1e-ba9a-2ca47b0347a3 on hv-cinder-83124 Jun 03 15:35:26.522811 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-33e30820-d5cb-4309-8c9b-a15d0e6089ae req-af4fe6e9-8bf6-47b9-a8ae-64e05a472387 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042943 Jun 03 15:35:26.523483 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 508/1036] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:35:26.977429 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7eea595f-fa0a-4f73-9b53-71225291866b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:26.978382 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7eea595f-fa0a-4f73-9b53-71225291866b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:27.003521 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7eea595f-fa0a-4f73-9b53-71225291866b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:27.004995 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7eea595f-fa0a-4f73-9b53-71225291866b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:27.007361 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7eea595f-fa0a-4f73-9b53-71225291866b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:27.008311 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7eea595f-fa0a-4f73-9b53-71225291866b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:27.270440 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7eea595f-fa0a-4f73-9b53-71225291866b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:27.281781 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7eea595f-fa0a-4f73-9b53-71225291866b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1314 microversion: 2.1 time: 0.311511 Jun 03 15:35:27.282616 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 529/1037] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:26 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:27.504877 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b9573c4a-a7b2-4b37-885a-f3338ef60b1f tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:27.505437 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b9573c4a-a7b2-4b37-885a-f3338ef60b1f tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:27.512802 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b9573c4a-a7b2-4b37-885a-f3338ef60b1f tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:27.513383 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b9573c4a-a7b2-4b37-885a-f3338ef60b1f tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:27.514781 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b9573c4a-a7b2-4b37-885a-f3338ef60b1f tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:27.515171 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b9573c4a-a7b2-4b37-885a-f3338ef60b1f tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:27.541984 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b9573c4a-a7b2-4b37-885a-f3338ef60b1f tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:35:27.633027 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b9573c4a-a7b2-4b37-885a-f3338ef60b1f tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "DELETE /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 204 len: 0 microversion: 2.1 time: 0.132881 Jun 03 15:35:27.633734 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 509/1038] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:35:27 2022] DELETE /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:35:27.643619 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7f60e8fd-94e8-4ffb-b30c-28c648ecee9c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:27.644275 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7f60e8fd-94e8-4ffb-b30c-28c648ecee9c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:27.652190 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7f60e8fd-94e8-4ffb-b30c-28c648ecee9c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:27.656553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7f60e8fd-94e8-4ffb-b30c-28c648ecee9c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:27.657648 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7f60e8fd-94e8-4ffb-b30c-28c648ecee9c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:27.658919 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7f60e8fd-94e8-4ffb-b30c-28c648ecee9c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:27.845701 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7f60e8fd-94e8-4ffb-b30c-28c648ecee9c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:27.853450 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7f60e8fd-94e8-4ffb-b30c-28c648ecee9c tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1513 microversion: 2.1 time: 0.214965 Jun 03 15:35:27.854035 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 530/1039] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:27 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:28.302465 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-44a3acd3-327b-443d-a190-28e4650cdce4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:28.303310 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-44a3acd3-327b-443d-a190-28e4650cdce4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:28.309856 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44a3acd3-327b-443d-a190-28e4650cdce4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:28.310961 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44a3acd3-327b-443d-a190-28e4650cdce4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:28.311781 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44a3acd3-327b-443d-a190-28e4650cdce4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:28.312409 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-44a3acd3-327b-443d-a190-28e4650cdce4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:28.469519 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-44a3acd3-327b-443d-a190-28e4650cdce4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:28.481013 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-44a3acd3-327b-443d-a190-28e4650cdce4 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1314 microversion: 2.1 time: 0.182405 Jun 03 15:35:28.482055 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 510/1040] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:28 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:28.870930 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d15fb8df-862b-4dbd-a188-59081615fa7e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:28.871566 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d15fb8df-862b-4dbd-a188-59081615fa7e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:28.878382 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d15fb8df-862b-4dbd-a188-59081615fa7e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:28.878859 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d15fb8df-862b-4dbd-a188-59081615fa7e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:28.879627 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d15fb8df-862b-4dbd-a188-59081615fa7e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:28.880078 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d15fb8df-862b-4dbd-a188-59081615fa7e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:29.049777 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d15fb8df-862b-4dbd-a188-59081615fa7e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:29.057507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d15fb8df-862b-4dbd-a188-59081615fa7e tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1513 microversion: 2.1 time: 0.190516 Jun 03 15:35:29.058079 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 531/1041] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:28 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:29.500231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-419c8d4e-38e7-43d6-8499-816ebe836392 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:29.500836 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-419c8d4e-38e7-43d6-8499-816ebe836392 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:29.507584 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-419c8d4e-38e7-43d6-8499-816ebe836392 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:29.508107 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-419c8d4e-38e7-43d6-8499-816ebe836392 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:29.508875 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-419c8d4e-38e7-43d6-8499-816ebe836392 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:29.509303 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-419c8d4e-38e7-43d6-8499-816ebe836392 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:29.663585 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-419c8d4e-38e7-43d6-8499-816ebe836392 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:29.671906 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-419c8d4e-38e7-43d6-8499-816ebe836392 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1314 microversion: 2.1 time: 0.175940 Jun 03 15:35:29.672734 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 511/1042] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:29 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:30.076070 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5a0a5b26-c353-4a53-a96c-0289116be5e7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:30.077668 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5a0a5b26-c353-4a53-a96c-0289116be5e7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:30.087601 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5a0a5b26-c353-4a53-a96c-0289116be5e7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:30.088553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5a0a5b26-c353-4a53-a96c-0289116be5e7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:30.089709 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5a0a5b26-c353-4a53-a96c-0289116be5e7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:30.090325 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5a0a5b26-c353-4a53-a96c-0289116be5e7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:30.665072 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5a0a5b26-c353-4a53-a96c-0289116be5e7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:30.683340 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5a0a5b26-c353-4a53-a96c-0289116be5e7 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1513 microversion: 2.1 time: 0.611517 Jun 03 15:35:30.690082 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1d2b97d7-c8c5-4368-900c-053a00833768 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:30.691368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1d2b97d7-c8c5-4368-900c-053a00833768 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:30.695380 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 532/1043] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:30 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1513 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:30.703053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d2b97d7-c8c5-4368-900c-053a00833768 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:30.703753 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d2b97d7-c8c5-4368-900c-053a00833768 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:30.704711 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d2b97d7-c8c5-4368-900c-053a00833768 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:30.707469 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1d2b97d7-c8c5-4368-900c-053a00833768 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:30.847490 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-f1c9bba1-8018-450d-bfab-1ea1b6b7050a req-17fa3294-d9ec-411c-b970-5ae90ff9e1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e324bc-ede1-49c6-b397-7cd7eef8fe4d", "name": "network-vif-deleted", "tag": "a2683068-e975-44f9-bfbb-088b723434a1"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:30.868265 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-f1c9bba1-8018-450d-bfab-1ea1b6b7050a req-17fa3294-d9ec-411c-b970-5ae90ff9e1a8 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:30.868810 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-f1c9bba1-8018-450d-bfab-1ea1b6b7050a req-17fa3294-d9ec-411c-b970-5ae90ff9e1a8 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:30.894440 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-f1c9bba1-8018-450d-bfab-1ea1b6b7050a req-17fa3294-d9ec-411c-b970-5ae90ff9e1a8 service nova] Creating event network-vif-deleted:a2683068-e975-44f9-bfbb-088b723434a1 for instance 73e324bc-ede1-49c6-b397-7cd7eef8fe4d on hv-cinder-83124 Jun 03 15:35:30.903811 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-f1c9bba1-8018-450d-bfab-1ea1b6b7050a req-17fa3294-d9ec-411c-b970-5ae90ff9e1a8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060603 Jun 03 15:35:30.905038 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 533/1044] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:35:30.946975 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-1d2b97d7-c8c5-4368-900c-053a00833768 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:30.956126 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1d2b97d7-c8c5-4368-900c-053a00833768 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1314 microversion: 2.1 time: 0.270331 Jun 03 15:35:30.956705 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 512/1045] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:30 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:31.713038 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:31.713824 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:31.720785 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:31.721323 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:31.722480 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:31.722835 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:31.759684 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:31.760138 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:31.760595 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lazy-loading 'fault' on Instance uuid 73e324bc-ede1-49c6-b397-7cd7eef8fe4d {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:35:31.810197 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:31.818606 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1e66f6b0-9c38-4139-9923-4552e5e5fed5 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1308 microversion: 2.1 time: 0.110209 Jun 03 15:35:31.819404 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 534/1046] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:31 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:31.973809 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-07adeced-d7a7-45d5-aab8-1ce166ff3d37 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:31.975168 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-07adeced-d7a7-45d5-aab8-1ce166ff3d37 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:31.984417 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07adeced-d7a7-45d5-aab8-1ce166ff3d37 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:31.985008 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07adeced-d7a7-45d5-aab8-1ce166ff3d37 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:31.986128 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07adeced-d7a7-45d5-aab8-1ce166ff3d37 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:31.986593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-07adeced-d7a7-45d5-aab8-1ce166ff3d37 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:32.171129 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-07adeced-d7a7-45d5-aab8-1ce166ff3d37 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:32.178636 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-07adeced-d7a7-45d5-aab8-1ce166ff3d37 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1314 microversion: 2.1 time: 0.209005 Jun 03 15:35:32.189675 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 513/1047] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:31 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:32.836807 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:32.837429 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:32.848909 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:32.849623 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:32.850662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:32.851193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:32.902247 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:32.902736 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:32.903862 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lazy-loading 'fault' on Instance uuid 73e324bc-ede1-49c6-b397-7cd7eef8fe4d {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:35:32.980669 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:32.989229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-1022fad6-ddff-47a6-87d6-face2858154c req-8891eeb2-a73e-4d60-90c9-7208ea19969b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f349a02-689d-4a1e-ba9a-2ca47b0347a3", "name": "network-vif-plugged", "status": "completed", "tag": "5ac0e121-8695-4bc9-bd81-da3b65bd09aa"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:32.992121 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-faaa21ef-a923-4129-a5e3-d6091eac09db tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1308 microversion: 2.1 time: 0.158695 Jun 03 15:35:33.003433 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 535/1048] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:32 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:33.013032 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-1022fad6-ddff-47a6-87d6-face2858154c req-8891eeb2-a73e-4d60-90c9-7208ea19969b service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:33.013481 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-1022fad6-ddff-47a6-87d6-face2858154c req-8891eeb2-a73e-4d60-90c9-7208ea19969b service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:33.029422 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-1022fad6-ddff-47a6-87d6-face2858154c req-8891eeb2-a73e-4d60-90c9-7208ea19969b service nova] Creating event network-vif-plugged:5ac0e121-8695-4bc9-bd81-da3b65bd09aa for instance 8f349a02-689d-4a1e-ba9a-2ca47b0347a3 on hv-cinder-83124 Jun 03 15:35:33.036927 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-1022fad6-ddff-47a6-87d6-face2858154c req-8891eeb2-a73e-4d60-90c9-7208ea19969b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055298 Jun 03 15:35:33.037902 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 514/1049] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:35:33.196286 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d35209cb-1f95-41b5-b257-1644f1b142de tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:33.196974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d35209cb-1f95-41b5-b257-1644f1b142de tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:33.205719 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d35209cb-1f95-41b5-b257-1644f1b142de tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:33.206310 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d35209cb-1f95-41b5-b257-1644f1b142de tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:33.207341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d35209cb-1f95-41b5-b257-1644f1b142de tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:33.208112 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d35209cb-1f95-41b5-b257-1644f1b142de tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:33.375525 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d35209cb-1f95-41b5-b257-1644f1b142de tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:33.384189 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d35209cb-1f95-41b5-b257-1644f1b142de tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1314 microversion: 2.1 time: 0.191907 Jun 03 15:35:33.384773 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 536/1050] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:33 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:34.011974 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:34.012679 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:34.015278 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:34.024532 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:34.025323 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:34.027158 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:34.027829 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:34.101867 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:34.101867 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:34.101867 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lazy-loading 'fault' on Instance uuid 73e324bc-ede1-49c6-b397-7cd7eef8fe4d {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:35:34.179865 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b82f76d685041d084dd5f332a5b1105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5151421b3ee4477924cdab41025075b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:34.189432 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-58726409-e92d-4e97-a97b-1afb39448112 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 200 len: 1308 microversion: 2.1 time: 0.181955 Jun 03 15:35:34.190010 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 515/1051] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:34 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:34.404987 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-478748d4-48f7-4a51-9002-697e29b2eae7 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:34.405977 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-478748d4-48f7-4a51-9002-697e29b2eae7 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:34.408118 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:34.408708 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=6 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:34.415622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-478748d4-48f7-4a51-9002-697e29b2eae7 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:34.416063 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-478748d4-48f7-4a51-9002-697e29b2eae7 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:34.416830 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-478748d4-48f7-4a51-9002-697e29b2eae7 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:34.417259 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-478748d4-48f7-4a51-9002-697e29b2eae7 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:34.572507 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-478748d4-48f7-4a51-9002-697e29b2eae7 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:34.580215 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-478748d4-48f7-4a51-9002-697e29b2eae7 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1314 microversion: 2.1 time: 0.179217 Jun 03 15:35:34.580799 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 537/1052] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:34 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:34.671785 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-653858691", "imageRef": "3a7224aa-5243-49d1-955b-e3bd10f69279", "flavorRef": "452"}} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:34.729543 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.network.neutron [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] validate_networks() for None {{(pid=117805) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:35:35.211553 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9b4cbb80-bdcd-4511-8bbc-e47712f66810 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:35.213231 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-9b4cbb80-bdcd-4511-8bbc-e47712f66810 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] [instance: 73e324bc-ede1-49c6-b397-7cd7eef8fe4d] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:35.222251 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9b4cbb80-bdcd-4511-8bbc-e47712f66810 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:35.223084 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9b4cbb80-bdcd-4511-8bbc-e47712f66810 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:35.224099 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9b4cbb80-bdcd-4511-8bbc-e47712f66810 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:35.224759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-9b4cbb80-bdcd-4511-8bbc-e47712f66810 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:35.242223 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-9b4cbb80-bdcd-4511-8bbc-e47712f66810 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] HTTP exception thrown: Instance 73e324bc-ede1-49c6-b397-7cd7eef8fe4d could not be found. Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9b4cbb80-bdcd-4511-8bbc-e47712f66810 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Request method failure captured: Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d HTTP/1.1 Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABiminIlSFGpr1yN86emZ3zYSFA7P2OtrryYpatLWUlUekAk--eLVYqygtfwEN8bA9-TsgrHs60uoOZAbTjRKMeOECYGsbwhw5mFcaJLwiCJ7AtaQU9H0OfoPCVTe4esBDLDg0UNBboHd0FGHi4zxwzSWJeyV4JlYlbkV8bwtbXPULrumU Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: d5151421b3ee4477924cdab41025075b Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-VolumesSnapshotTestJSON-349830551 Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:35:35.244119 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d5151421b3ee4477924cdab41025075b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d5151421b3ee4477924cdab41025075b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d5151421b3ee4477924cdab41025075b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d5151421b3ee4477924cdab41025075b"}]}] Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-VolumesSnapshotTestJSON-349830551 Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: d5151421b3ee4477924cdab41025075b Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-349830551 Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-VolumesSnapshotTestJSON-349830551-project Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 5b82f76d685041d084dd5f332a5b1105 Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-VolumesSnapshotTestJSON-349830551-project Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 73e324bc-ede1-49c6-b397-7cd7eef8fe4d could not be found. Jun 03 15:35:35.245691 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '73e324bc-ede1-49c6-b397-7cd7eef8fe4d'} Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e324bc-ede1-49c6-b397-7cd7eef8fe4d could not be found. Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:35:35.250228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e324bc-ede1-49c6-b397-7cd7eef8fe4d could not be found. Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e324bc-ede1-49c6-b397-7cd7eef8fe4d could not be found. Jun 03 15:35:35.253869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:35:35.255889 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-9b4cbb80-bdcd-4511-8bbc-e47712f66810 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] Returning 404 to user: Instance 73e324bc-ede1-49c6-b397-7cd7eef8fe4d could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:35:35.255889 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-9b4cbb80-bdcd-4511-8bbc-e47712f66810 tempest-VolumesSnapshotTestJSON-349830551 tempest-VolumesSnapshotTestJSON-349830551-project] 10.222.0.93 "GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d" status: 404 len: 111 microversion: 2.1 time: 0.040869 Jun 03 15:35:35.255889 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 538/1053] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:35 2022] GET /compute/v2.1/servers/73e324bc-ede1-49c6-b397-7cd7eef8fe4d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:35:35.293604 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Flavor limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:35:35.294085 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Image limits 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:35:35.294608 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Flavor pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:35:35.295087 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Image pref 0:0:0 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:35:35.295598 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.virt.hardware [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:35:35.305821 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:35.306248 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:35.315005 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:35.315005 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:35.328917 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Getting quotas for project acf00e4ef6f649e69980d6ec2c4b8bea. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:35:35.333646 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.quota [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Getting quotas for user 134977bf87a2409481cf99d98c8b2228 and project acf00e4ef6f649e69980d6ec2c4b8bea. Resources: {'cores', 'instances', 'ram'} {{(pid=117805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:35:35.347430 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Going to run 1 instances... {{(pid=117805) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:35:35.350120 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7224aa-5243-49d1-955b-e3bd10f69279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:35:35.401430 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-e5176b5b-c610-428b-855c-a4026f0cca28 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733847 Jun 03 15:35:35.402941 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 516/1054] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:35:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:35:35.413186 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a4f3daab-a986-457d-86a8-8f4ad40b371b tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:35.414866 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a4f3daab-a986-457d-86a8-8f4ad40b371b tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:35.532611 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-a4f3daab-a986-457d-86a8-8f4ad40b371b tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:35.541137 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a4f3daab-a986-457d-86a8-8f4ad40b371b tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1214 microversion: 2.1 time: 0.131744 Jun 03 15:35:35.541729 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 539/1055] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:35 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:35.599368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-591c0356-26cf-43ce-ac16-98eefa77f66a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:35.600308 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-591c0356-26cf-43ce-ac16-98eefa77f66a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:35.612185 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-591c0356-26cf-43ce-ac16-98eefa77f66a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:35.612794 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-591c0356-26cf-43ce-ac16-98eefa77f66a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:35.614136 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-591c0356-26cf-43ce-ac16-98eefa77f66a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:35.614860 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-591c0356-26cf-43ce-ac16-98eefa77f66a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:35.798423 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-591c0356-26cf-43ce-ac16-98eefa77f66a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:35.809784 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-591c0356-26cf-43ce-ac16-98eefa77f66a tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1497 microversion: 2.1 time: 0.215099 Jun 03 15:35:35.812190 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 517/1056] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:35 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:36.299292 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-a9cbd11a-41f8-4ef8-b507-c2f4d69ad86f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:36.299788 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a9cbd11a-41f8-4ef8-b507-c2f4d69ad86f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:36.306740 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a9cbd11a-41f8-4ef8-b507-c2f4d69ad86f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:36.307455 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a9cbd11a-41f8-4ef8-b507-c2f4d69ad86f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:36.308243 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a9cbd11a-41f8-4ef8-b507-c2f4d69ad86f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:36.308682 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-a9cbd11a-41f8-4ef8-b507-c2f4d69ad86f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:36.335287 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-a9cbd11a-41f8-4ef8-b507-c2f4d69ad86f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Going to try to terminate instance {{(pid=117806) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:35:36.383472 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:36.437733 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-a9cbd11a-41f8-4ef8-b507-c2f4d69ad86f tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 204 len: 0 microversion: 2.1 time: 0.142389 Jun 03 15:35:36.438834 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 540/1057] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:35:36 2022] DELETE /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 15:35:36.451330 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-20103657-8ca7-46f1-b488-2eebb476725d tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:36.453755 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-20103657-8ca7-46f1-b488-2eebb476725d tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:36.472869 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20103657-8ca7-46f1-b488-2eebb476725d tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:36.473985 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20103657-8ca7-46f1-b488-2eebb476725d tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:36.475317 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20103657-8ca7-46f1-b488-2eebb476725d tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:36.476192 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-20103657-8ca7-46f1-b488-2eebb476725d tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:36.559367 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-ffc3a961-5f67-4106-9bcf-ea0f3212a82c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:36.560062 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-ffc3a961-5f67-4106-9bcf-ea0f3212a82c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:36.566264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ffc3a961-5f67-4106-9bcf-ea0f3212a82c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:36.566796 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ffc3a961-5f67-4106-9bcf-ea0f3212a82c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:36.567594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ffc3a961-5f67-4106-9bcf-ea0f3212a82c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:36.568026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-ffc3a961-5f67-4106-9bcf-ea0f3212a82c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:36.631160 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-20103657-8ca7-46f1-b488-2eebb476725d tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:36.642178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-20103657-8ca7-46f1-b488-2eebb476725d tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1503 microversion: 2.1 time: 0.197991 Jun 03 15:35:36.642543 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-ffc3a961-5f67-4106-9bcf-ea0f3212a82c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:36.643161 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 518/1058] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:36 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:36.652227 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-ffc3a961-5f67-4106-9bcf-ea0f3212a82c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1266 microversion: 2.1 time: 0.096964 Jun 03 15:35:36.653893 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 541/1059] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:36 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:37.661446 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7eafae71-3bc6-4893-9234-7533d0b5b35b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:37.662224 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7eafae71-3bc6-4893-9234-7533d0b5b35b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:37.669984 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7eafae71-3bc6-4893-9234-7533d0b5b35b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:37.670314 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7eafae71-3bc6-4893-9234-7533d0b5b35b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:37.671261 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7eafae71-3bc6-4893-9234-7533d0b5b35b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:37.671573 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7eafae71-3bc6-4893-9234-7533d0b5b35b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:37.673677 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d37a4478-e650-4ace-ad38-4890b0483a3c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:37.674899 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d37a4478-e650-4ace-ad38-4890b0483a3c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:37.691407 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d37a4478-e650-4ace-ad38-4890b0483a3c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:37.691937 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d37a4478-e650-4ace-ad38-4890b0483a3c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:37.692724 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d37a4478-e650-4ace-ad38-4890b0483a3c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:37.693152 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d37a4478-e650-4ace-ad38-4890b0483a3c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:37.776930 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d37a4478-e650-4ace-ad38-4890b0483a3c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:37.786337 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d37a4478-e650-4ace-ad38-4890b0483a3c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1274 microversion: 2.1 time: 0.117368 Jun 03 15:35:37.787497 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 542/1060] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:37 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:37.831681 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7eafae71-3bc6-4893-9234-7533d0b5b35b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:37.843751 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7eafae71-3bc6-4893-9234-7533d0b5b35b tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1503 microversion: 2.1 time: 0.186146 Jun 03 15:35:37.844567 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 519/1061] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:37 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:38.805296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-2f282478-3095-4e21-ab2a-c07837b9011a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:38.805959 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-2f282478-3095-4e21-ab2a-c07837b9011a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:38.812742 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2f282478-3095-4e21-ab2a-c07837b9011a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:38.813191 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2f282478-3095-4e21-ab2a-c07837b9011a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:38.813963 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2f282478-3095-4e21-ab2a-c07837b9011a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:38.814400 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-2f282478-3095-4e21-ab2a-c07837b9011a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:38.863778 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1a13dee7-8f67-4c54-9457-3653e0ff74b8 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:38.864611 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1a13dee7-8f67-4c54-9457-3653e0ff74b8 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:38.872700 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1a13dee7-8f67-4c54-9457-3653e0ff74b8 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:38.873194 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1a13dee7-8f67-4c54-9457-3653e0ff74b8 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:38.874045 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1a13dee7-8f67-4c54-9457-3653e0ff74b8 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:38.874632 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1a13dee7-8f67-4c54-9457-3653e0ff74b8 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:38.882622 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-2f282478-3095-4e21-ab2a-c07837b9011a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:38.891394 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-2f282478-3095-4e21-ab2a-c07837b9011a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1274 microversion: 2.1 time: 0.089885 Jun 03 15:35:38.892042 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 543/1062] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:38 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:39.025421 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-1a13dee7-8f67-4c54-9457-3653e0ff74b8 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:39.034710 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1a13dee7-8f67-4c54-9457-3653e0ff74b8 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1503 microversion: 2.1 time: 0.176917 Jun 03 15:35:39.035385 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 520/1063] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:38 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:39.914901 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e36f7a09-566a-4878-b9d3-93bfb15e202d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:39.915722 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e36f7a09-566a-4878-b9d3-93bfb15e202d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:39.922035 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e36f7a09-566a-4878-b9d3-93bfb15e202d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:39.922487 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e36f7a09-566a-4878-b9d3-93bfb15e202d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:39.923318 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e36f7a09-566a-4878-b9d3-93bfb15e202d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:39.923759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e36f7a09-566a-4878-b9d3-93bfb15e202d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:40.004426 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e36f7a09-566a-4878-b9d3-93bfb15e202d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:40.019137 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e36f7a09-566a-4878-b9d3-93bfb15e202d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1274 microversion: 2.1 time: 0.108554 Jun 03 15:35:40.020678 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 544/1064] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:39 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:40.056996 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b59dfc3a-faf4-44c1-9c7f-6440246457d3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:40.058212 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b59dfc3a-faf4-44c1-9c7f-6440246457d3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:40.068390 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:40.075603 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b59dfc3a-faf4-44c1-9c7f-6440246457d3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:40.076122 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b59dfc3a-faf4-44c1-9c7f-6440246457d3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:40.077467 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b59dfc3a-faf4-44c1-9c7f-6440246457d3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:40.077907 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b59dfc3a-faf4-44c1-9c7f-6440246457d3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:40.293003 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b59dfc3a-faf4-44c1-9c7f-6440246457d3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:40.296959 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:40.302123 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b59dfc3a-faf4-44c1-9c7f-6440246457d3 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1503 microversion: 2.1 time: 0.252550 Jun 03 15:35:40.307053 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 521/1065] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:40 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:40.909196 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-d1fec835-69bf-46cf-a84b-3a332e26c809 req-940266ec-758e-400e-8863-d58640800d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f349a02-689d-4a1e-ba9a-2ca47b0347a3", "name": "network-vif-deleted", "tag": "5ac0e121-8695-4bc9-bd81-da3b65bd09aa"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:40.924850 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-d1fec835-69bf-46cf-a84b-3a332e26c809 req-940266ec-758e-400e-8863-d58640800d91 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:40.925662 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-d1fec835-69bf-46cf-a84b-3a332e26c809 req-940266ec-758e-400e-8863-d58640800d91 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:40.947584 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-d1fec835-69bf-46cf-a84b-3a332e26c809 req-940266ec-758e-400e-8863-d58640800d91 service nova] Creating event network-vif-deleted:5ac0e121-8695-4bc9-bd81-da3b65bd09aa for instance 8f349a02-689d-4a1e-ba9a-2ca47b0347a3 on hv-cinder-83124 Jun 03 15:35:40.955453 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-d1fec835-69bf-46cf-a84b-3a332e26c809 req-940266ec-758e-400e-8863-d58640800d91 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049996 Jun 03 15:35:40.973552 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 545/1066] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:35:41.040741 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1b4db16a-1c78-4c6c-85bf-7d34e570799c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:41.041975 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-1b4db16a-1c78-4c6c-85bf-7d34e570799c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:41.053769 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1b4db16a-1c78-4c6c-85bf-7d34e570799c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:41.054623 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1b4db16a-1c78-4c6c-85bf-7d34e570799c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:41.055714 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1b4db16a-1c78-4c6c-85bf-7d34e570799c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:41.056425 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-1b4db16a-1c78-4c6c-85bf-7d34e570799c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:41.331332 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:41.332788 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:41.393125 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:41.393974 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:41.397069 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:41.401860 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:41.448078 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-1b4db16a-1c78-4c6c-85bf-7d34e570799c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:41.459324 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1b4db16a-1c78-4c6c-85bf-7d34e570799c tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1314 microversion: 2.1 time: 0.424687 Jun 03 15:35:41.460019 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 522/1067] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:41 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:41.527683 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:41.530695 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:41.531155 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.objects.instance [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lazy-loading 'fault' on Instance uuid 8f349a02-689d-4a1e-ba9a-2ca47b0347a3 {{(pid=117806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:35:41.626102 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db856168c34491080b93c8ee5680c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5131601b14b5884956a189e6e9462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:41.638381 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d3779d6f-009b-4eff-ba0d-ad5a9ca34d34 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 200 len: 1304 microversion: 2.1 time: 0.320779 Jun 03 15:35:41.650224 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 546/1068] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:41 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 1304 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:42.256062 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-1d785996-9974-4d93-9412-1aad35d60bf4 req-c05e7672-bc34-4edc-844c-f82a13873fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e7e98e-b346-46c1-b4ef-4147973eafff", "tag": "fabf68f2-87b5-4ccc-8fc4-fb833ea6d856"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:42.270848 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-1d785996-9974-4d93-9412-1aad35d60bf4 req-c05e7672-bc34-4edc-844c-f82a13873fb2 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:42.271608 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-1d785996-9974-4d93-9412-1aad35d60bf4 req-c05e7672-bc34-4edc-844c-f82a13873fb2 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:42.296107 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-1d785996-9974-4d93-9412-1aad35d60bf4 req-c05e7672-bc34-4edc-844c-f82a13873fb2 service nova] Creating event network-changed:fabf68f2-87b5-4ccc-8fc4-fb833ea6d856 for instance 63e7e98e-b346-46c1-b4ef-4147973eafff on hv-cinder-83124 Jun 03 15:35:42.302211 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-1d785996-9974-4d93-9412-1aad35d60bf4 req-c05e7672-bc34-4edc-844c-f82a13873fb2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049965 Jun 03 15:35:42.303546 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 523/1069] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:35:42.479228 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-7c8e194e-7272-4b8e-97c1-377aef3902cc tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:42.479700 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-7c8e194e-7272-4b8e-97c1-377aef3902cc tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:42.487587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c8e194e-7272-4b8e-97c1-377aef3902cc tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:42.488262 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c8e194e-7272-4b8e-97c1-377aef3902cc tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:42.489293 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c8e194e-7272-4b8e-97c1-377aef3902cc tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:42.489726 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-7c8e194e-7272-4b8e-97c1-377aef3902cc tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:42.639394 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-7c8e194e-7272-4b8e-97c1-377aef3902cc tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:42.647857 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-7c8e194e-7272-4b8e-97c1-377aef3902cc tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1314 microversion: 2.1 time: 0.173340 Jun 03 15:35:42.648435 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 547/1070] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:42 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:42.665658 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6100f45d-3550-4386-bd1c-ac5b58fff4e0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:42.667229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6100f45d-3550-4386-bd1c-ac5b58fff4e0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] [instance: 8f349a02-689d-4a1e-ba9a-2ca47b0347a3] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:42.675888 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6100f45d-3550-4386-bd1c-ac5b58fff4e0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:42.676622 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6100f45d-3550-4386-bd1c-ac5b58fff4e0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:42.677420 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6100f45d-3550-4386-bd1c-ac5b58fff4e0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:42.677869 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6100f45d-3550-4386-bd1c-ac5b58fff4e0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:42.692834 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-6100f45d-3550-4386-bd1c-ac5b58fff4e0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] HTTP exception thrown: Instance 8f349a02-689d-4a1e-ba9a-2ca47b0347a3 could not be found. Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6100f45d-3550-4386-bd1c-ac5b58fff4e0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Request method failure captured: Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 HTTP/1.1 Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimiocVKNZIa8NyUCEAvH8yPEov4pGMBrTz6pRKvOQRsAlBEBBeYlQhGQkAenv0IjJlxSbvrgvJLsT-aMTIrQLx394FBxYuVN5CWSoAVHBbf70rSSxUK1slqpU-M_agW-bVGJLnDgSUZ8NeaOAMIhVKctHfF5eMyEwnrUricCdnESXUso Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: bcb5131601b14b5884956a189e6e9462 Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-VolumesActionsTest-1331699078 Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:35:42.694523 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bcb5131601b14b5884956a189e6e9462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bcb5131601b14b5884956a189e6e9462"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_bcb5131601b14b5884956a189e6e9462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/bcb5131601b14b5884956a189e6e9462"}]}] Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-VolumesActionsTest-1331699078 Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: bcb5131601b14b5884956a189e6e9462 Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-VolumesActionsTest-1331699078 Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-VolumesActionsTest-1331699078-project Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 4db856168c34491080b93c8ee5680c2a Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-VolumesActionsTest-1331699078-project Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 8f349a02-689d-4a1e-ba9a-2ca47b0347a3 could not be found. Jun 03 15:35:42.696620 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '8f349a02-689d-4a1e-ba9a-2ca47b0347a3'} Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f349a02-689d-4a1e-ba9a-2ca47b0347a3 could not be found. Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:35:42.697890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f349a02-689d-4a1e-ba9a-2ca47b0347a3 could not be found. Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f349a02-689d-4a1e-ba9a-2ca47b0347a3 could not be found. Jun 03 15:35:42.700179 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:42.701593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6100f45d-3550-4386-bd1c-ac5b58fff4e0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] Returning 404 to user: Instance 8f349a02-689d-4a1e-ba9a-2ca47b0347a3 could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:35:42.701593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6100f45d-3550-4386-bd1c-ac5b58fff4e0 tempest-VolumesActionsTest-1331699078 tempest-VolumesActionsTest-1331699078-project] 10.222.0.93 "GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3" status: 404 len: 111 microversion: 2.1 time: 0.041014 Jun 03 15:35:42.701593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 524/1071] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:42 2022] GET /compute/v2.1/servers/8f349a02-689d-4a1e-ba9a-2ca47b0347a3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:35:43.665053 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-1b6ef32f-9147-448f-8d6c-9b6b569acec9 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:43.666090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-1b6ef32f-9147-448f-8d6c-9b6b569acec9 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:43.673855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1b6ef32f-9147-448f-8d6c-9b6b569acec9 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:43.674264 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1b6ef32f-9147-448f-8d6c-9b6b569acec9 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:43.675073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1b6ef32f-9147-448f-8d6c-9b6b569acec9 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:43.675511 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-1b6ef32f-9147-448f-8d6c-9b6b569acec9 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:43.821619 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-1b6ef32f-9147-448f-8d6c-9b6b569acec9 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:43.829831 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-1b6ef32f-9147-448f-8d6c-9b6b569acec9 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1314 microversion: 2.1 time: 0.168672 Jun 03 15:35:43.830408 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 548/1072] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:43 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:44.847373 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b640edd1-8487-4359-9420-adc36b79257d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:44.847982 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b640edd1-8487-4359-9420-adc36b79257d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:44.855294 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b640edd1-8487-4359-9420-adc36b79257d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:44.855748 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b640edd1-8487-4359-9420-adc36b79257d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:44.856521 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b640edd1-8487-4359-9420-adc36b79257d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:44.857230 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b640edd1-8487-4359-9420-adc36b79257d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:44.990785 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b640edd1-8487-4359-9420-adc36b79257d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:44.998368 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b640edd1-8487-4359-9420-adc36b79257d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1314 microversion: 2.1 time: 0.154917 Jun 03 15:35:44.999540 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 525/1073] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:44 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:46.018031 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5b2e072d-ab4b-49c6-8582-8e821a0378a4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:46.019157 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5b2e072d-ab4b-49c6-8582-8e821a0378a4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:46.021904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:46.028585 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5b2e072d-ab4b-49c6-8582-8e821a0378a4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:46.029024 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5b2e072d-ab4b-49c6-8582-8e821a0378a4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:46.029808 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5b2e072d-ab4b-49c6-8582-8e821a0378a4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:46.030238 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5b2e072d-ab4b-49c6-8582-8e821a0378a4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:46.172776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5b2e072d-ab4b-49c6-8582-8e821a0378a4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:46.185296 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5b2e072d-ab4b-49c6-8582-8e821a0378a4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1314 microversion: 2.1 time: 0.172084 Jun 03 15:35:46.186781 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 549/1074] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:46 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:47.203957 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b9d01aaa-2d7b-496d-b2a8-a03aeb49b620 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:47.204658 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b9d01aaa-2d7b-496d-b2a8-a03aeb49b620 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:47.206491 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:47.207183 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=6 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:47.218024 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b9d01aaa-2d7b-496d-b2a8-a03aeb49b620 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:47.218495 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b9d01aaa-2d7b-496d-b2a8-a03aeb49b620 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:47.219335 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b9d01aaa-2d7b-496d-b2a8-a03aeb49b620 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:47.219774 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b9d01aaa-2d7b-496d-b2a8-a03aeb49b620 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:47.359445 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b9d01aaa-2d7b-496d-b2a8-a03aeb49b620 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:47.367159 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b9d01aaa-2d7b-496d-b2a8-a03aeb49b620 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1314 microversion: 2.1 time: 0.167180 Jun 03 15:35:47.367718 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 526/1075] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:47 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:48.384926 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c45ed67b-a579-4816-b94c-85d859d575f2 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:48.386598 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c45ed67b-a579-4816-b94c-85d859d575f2 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:48.389780 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:48.395965 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c45ed67b-a579-4816-b94c-85d859d575f2 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:48.396580 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c45ed67b-a579-4816-b94c-85d859d575f2 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:48.397375 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c45ed67b-a579-4816-b94c-85d859d575f2 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:48.398009 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c45ed67b-a579-4816-b94c-85d859d575f2 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:48.574441 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-c45ed67b-a579-4816-b94c-85d859d575f2 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:48.582837 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c45ed67b-a579-4816-b94c-85d859d575f2 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1314 microversion: 2.1 time: 0.201830 Jun 03 15:35:48.584126 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 550/1076] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:48 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:49.194987 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-bdd8385b-d84b-4812-97c7-56c49f203c19 req-70425392-7264-47c4-a12d-3eb1c28fe250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e7e98e-b346-46c1-b4ef-4147973eafff", "name": "network-vif-plugged", "status": "completed", "tag": "fabf68f2-87b5-4ccc-8fc4-fb833ea6d856"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:49.209662 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-bdd8385b-d84b-4812-97c7-56c49f203c19 req-70425392-7264-47c4-a12d-3eb1c28fe250 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:49.210418 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-bdd8385b-d84b-4812-97c7-56c49f203c19 req-70425392-7264-47c4-a12d-3eb1c28fe250 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:49.226341 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-bdd8385b-d84b-4812-97c7-56c49f203c19 req-70425392-7264-47c4-a12d-3eb1c28fe250 service nova] Creating event network-vif-plugged:fabf68f2-87b5-4ccc-8fc4-fb833ea6d856 for instance 63e7e98e-b346-46c1-b4ef-4147973eafff on hv-cinder-83124 Jun 03 15:35:49.234330 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-bdd8385b-d84b-4812-97c7-56c49f203c19 req-70425392-7264-47c4-a12d-3eb1c28fe250 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041891 Jun 03 15:35:49.234965 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 527/1077] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:35:49.605208 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-0d376cef-a121-4ce5-8237-515156887f69 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:49.606040 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-0d376cef-a121-4ce5-8237-515156887f69 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:49.613109 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0d376cef-a121-4ce5-8237-515156887f69 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:49.613649 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0d376cef-a121-4ce5-8237-515156887f69 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:49.614490 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0d376cef-a121-4ce5-8237-515156887f69 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:49.615065 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-0d376cef-a121-4ce5-8237-515156887f69 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:49.796248 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-0d376cef-a121-4ce5-8237-515156887f69 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:49.805275 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-0d376cef-a121-4ce5-8237-515156887f69 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1314 microversion: 2.1 time: 0.203807 Jun 03 15:35:49.805854 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 551/1078] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:49 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:50.839413 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-90250d46-6f08-477e-ba8e-1eb92e1d8f0d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:50.841792 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-90250d46-6f08-477e-ba8e-1eb92e1d8f0d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:50.867812 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-90250d46-6f08-477e-ba8e-1eb92e1d8f0d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:50.868298 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-90250d46-6f08-477e-ba8e-1eb92e1d8f0d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:50.869097 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-90250d46-6f08-477e-ba8e-1eb92e1d8f0d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:50.869543 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-90250d46-6f08-477e-ba8e-1eb92e1d8f0d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:51.065449 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-90250d46-6f08-477e-ba8e-1eb92e1d8f0d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:51.075835 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-90250d46-6f08-477e-ba8e-1eb92e1d8f0d tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1314 microversion: 2.1 time: 0.256319 Jun 03 15:35:51.076933 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 528/1079] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:50 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:52.093672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-f5a41fc5-ecf1-4b6e-8276-6d1c8ad281c8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:52.094374 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-f5a41fc5-ecf1-4b6e-8276-6d1c8ad281c8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:52.104149 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5a41fc5-ecf1-4b6e-8276-6d1c8ad281c8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:52.106771 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5a41fc5-ecf1-4b6e-8276-6d1c8ad281c8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:52.107907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5a41fc5-ecf1-4b6e-8276-6d1c8ad281c8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:52.108594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-f5a41fc5-ecf1-4b6e-8276-6d1c8ad281c8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:52.376460 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-f5a41fc5-ecf1-4b6e-8276-6d1c8ad281c8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:52.388240 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-f5a41fc5-ecf1-4b6e-8276-6d1c8ad281c8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1314 microversion: 2.1 time: 0.298667 Jun 03 15:35:52.388915 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 552/1080] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:52 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:53.408518 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-32f85970-3eab-44ee-84af-3670ecbf29b0 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:53.410566 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-32f85970-3eab-44ee-84af-3670ecbf29b0 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:53.417742 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32f85970-3eab-44ee-84af-3670ecbf29b0 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:53.418197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32f85970-3eab-44ee-84af-3670ecbf29b0 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:53.419055 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32f85970-3eab-44ee-84af-3670ecbf29b0 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:53.419656 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-32f85970-3eab-44ee-84af-3670ecbf29b0 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:53.600120 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-32f85970-3eab-44ee-84af-3670ecbf29b0 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:53.615864 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-32f85970-3eab-44ee-84af-3670ecbf29b0 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1464 microversion: 2.1 time: 0.212347 Jun 03 15:35:53.616569 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 529/1081] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:53 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1464 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:53.660341 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e6c8ef12-486c-419e-ae6f-cdb26e2a1d2a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:53.660898 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e6c8ef12-486c-419e-ae6f-cdb26e2a1d2a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:53.668953 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6c8ef12-486c-419e-ae6f-cdb26e2a1d2a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:53.669404 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6c8ef12-486c-419e-ae6f-cdb26e2a1d2a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:53.670197 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6c8ef12-486c-419e-ae6f-cdb26e2a1d2a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:53.670714 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6c8ef12-486c-419e-ae6f-cdb26e2a1d2a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:53.704587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e6c8ef12-486c-419e-ae6f-cdb26e2a1d2a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Going to try to terminate instance {{(pid=117806) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:35:53.828577 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e6c8ef12-486c-419e-ae6f-cdb26e2a1d2a tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "DELETE /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 204 len: 0 microversion: 2.1 time: 0.172174 Jun 03 15:35:53.829627 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 553/1082] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:35:53 2022] DELETE /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:35:53.845005 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-62fcf8f2-e8ce-4656-a8e2-266980a2452e tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:53.845661 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-62fcf8f2-e8ce-4656-a8e2-266980a2452e tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:53.852236 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-62fcf8f2-e8ce-4656-a8e2-266980a2452e tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:53.852969 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-62fcf8f2-e8ce-4656-a8e2-266980a2452e tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:53.854048 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-62fcf8f2-e8ce-4656-a8e2-266980a2452e tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:53.854488 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-62fcf8f2-e8ce-4656-a8e2-266980a2452e tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:54.003791 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-62fcf8f2-e8ce-4656-a8e2-266980a2452e tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:54.014976 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-62fcf8f2-e8ce-4656-a8e2-266980a2452e tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1470 microversion: 2.1 time: 0.174932 Jun 03 15:35:54.025313 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 530/1083] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:53 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:55.033666 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e5c1733d-bb91-4812-abb2-4b13566fc5f4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:55.035106 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e5c1733d-bb91-4812-abb2-4b13566fc5f4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:55.042276 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e5c1733d-bb91-4812-abb2-4b13566fc5f4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:55.042855 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e5c1733d-bb91-4812-abb2-4b13566fc5f4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:55.044022 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e5c1733d-bb91-4812-abb2-4b13566fc5f4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:55.044703 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e5c1733d-bb91-4812-abb2-4b13566fc5f4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:55.209528 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e5c1733d-bb91-4812-abb2-4b13566fc5f4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:55.220688 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e5c1733d-bb91-4812-abb2-4b13566fc5f4 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1470 microversion: 2.1 time: 0.191349 Jun 03 15:35:55.221689 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 554/1084] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:55 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:35:56.196617 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [req-02b837a3-9ea5-47d4-87ce-21234c85ef1b req-9fa7fa68-27a9-4187-9c7e-067caa99e64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e7e98e-b346-46c1-b4ef-4147973eafff", "name": "network-vif-deleted", "tag": "fabf68f2-87b5-4ccc-8fc4-fb833ea6d856"}]} {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:35:56.212484 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-02b837a3-9ea5-47d4-87ce-21234c85ef1b req-9fa7fa68-27a9-4187-9c7e-067caa99e64f service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:56.213361 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [req-02b837a3-9ea5-47d4-87ce-21234c85ef1b req-9fa7fa68-27a9-4187-9c7e-067caa99e64f service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:56.239843 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-610bfa30-d989-47e7-833b-d209dbf49153 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:56.240511 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-610bfa30-d989-47e7-833b-d209dbf49153 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:56.245539 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.compute.server_external_events [req-02b837a3-9ea5-47d4-87ce-21234c85ef1b req-9fa7fa68-27a9-4187-9c7e-067caa99e64f service nova] Creating event network-vif-deleted:fabf68f2-87b5-4ccc-8fc4-fb833ea6d856 for instance 63e7e98e-b346-46c1-b4ef-4147973eafff on hv-cinder-83124 Jun 03 15:35:56.253267 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [req-02b837a3-9ea5-47d4-87ce-21234c85ef1b req-9fa7fa68-27a9-4187-9c7e-067caa99e64f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061382 Jun 03 15:35:56.255239 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-610bfa30-d989-47e7-833b-d209dbf49153 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:56.255869 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-610bfa30-d989-47e7-833b-d209dbf49153 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:56.256905 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-610bfa30-d989-47e7-833b-d209dbf49153 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:56.261942 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-610bfa30-d989-47e7-833b-d209dbf49153 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:56.262420 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 531/1085] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:35:56.290714 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:35:56.373456 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-610bfa30-d989-47e7-833b-d209dbf49153 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134977bf87a2409481cf99d98c8b2228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf00e4ef6f649e69980d6ec2c4b8bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:35:56.383990 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-610bfa30-d989-47e7-833b-d209dbf49153 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 200 len: 1299 microversion: 2.1 time: 0.148487 Jun 03 15:35:56.384839 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 555/1086] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:56 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 1299 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 15:35:57.402788 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5866b890-3629-452d-8b40-4bbc49b352a8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:35:57.404229 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5866b890-3629-452d-8b40-4bbc49b352a8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] [instance: 63e7e98e-b346-46c1-b4ef-4147973eafff] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:35:57.411426 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5866b890-3629-452d-8b40-4bbc49b352a8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:57.412183 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5866b890-3629-452d-8b40-4bbc49b352a8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:57.413300 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5866b890-3629-452d-8b40-4bbc49b352a8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:35:57.413789 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5866b890-3629-452d-8b40-4bbc49b352a8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:35:57.428322 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-5866b890-3629-452d-8b40-4bbc49b352a8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] HTTP exception thrown: Instance 63e7e98e-b346-46c1-b4ef-4147973eafff could not be found. Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5866b890-3629-452d-8b40-4bbc49b352a8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Request method failure captured: Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff HTTP/1.1 Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimipFJD5DkuV0Kw8IBUVgNJl9FR59w8qV_g_GlpjnqeyllJff8-0-TX9NlGwgZLhWPX9XX8CTs6TywrlclOEIaKxYs1m6PfxOdm0-pqM9hesj6-9ZoLmmT906pGpQ9--_DzwNSMNTTDgXK5uLEX-vYlTYoOdMVbQg_TWshYLCz_Zz1Zc Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: acf00e4ef6f649e69980d6ec2c4b8bea Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-VolumesNegativeTest-400186058 Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:35:57.430388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acf00e4ef6f649e69980d6ec2c4b8bea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acf00e4ef6f649e69980d6ec2c4b8bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acf00e4ef6f649e69980d6ec2c4b8bea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acf00e4ef6f649e69980d6ec2c4b8bea"}]}] Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-VolumesNegativeTest-400186058 Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: acf00e4ef6f649e69980d6ec2c4b8bea Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-VolumesNegativeTest-400186058 Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-VolumesNegativeTest-400186058-project Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 134977bf87a2409481cf99d98c8b2228 Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-VolumesNegativeTest-400186058-project Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 63e7e98e-b346-46c1-b4ef-4147973eafff could not be found. Jun 03 15:35:57.431842 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '63e7e98e-b346-46c1-b4ef-4147973eafff'} Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e7e98e-b346-46c1-b4ef-4147973eafff could not be found. Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:35:57.432631 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e7e98e-b346-46c1-b4ef-4147973eafff could not be found. Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e7e98e-b346-46c1-b4ef-4147973eafff could not be found. Jun 03 15:35:57.433892 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:35:57.436981 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5866b890-3629-452d-8b40-4bbc49b352a8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] Returning 404 to user: Instance 63e7e98e-b346-46c1-b4ef-4147973eafff could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:35:57.438177 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5866b890-3629-452d-8b40-4bbc49b352a8 tempest-VolumesNegativeTest-400186058 tempest-VolumesNegativeTest-400186058-project] 10.222.0.93 "GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff" status: 404 len: 111 microversion: 2.1 time: 0.040070 Jun 03 15:35:57.438728 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 532/1087] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:35:57 2022] GET /compute/v2.1/servers/63e7e98e-b346-46c1-b4ef-4147973eafff => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:36:43.780197 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:36:43.780876 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Fri Jun 3 15:36:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:36:51.584017 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:36:51.584633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Fri Jun 3 15:36:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:37:23.453950 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:37:23.454770 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:37:23.459026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1304751898", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1350769796", "security_groups": [{"name": "tempest-secgroup-smoke-168875648"}], "block_device_mapping_v2": [{"uuid": "c1a17bd5-312d-4698-aef2-5047b65cafa9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2d580292-795d-4fee-87ce-011961d3c846"}]}} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:37:23.681725 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.network.neutron [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] validate_networks() for [('2d580292-795d-4fee-87ce-011961d3c846', None, None, None, None, None)] {{(pid=117806) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 15:37:24.061669 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Flavor limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 15:37:24.062094 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Image limits 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 15:37:24.062587 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Flavor pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 15:37:24.062998 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Image pref 0:0:0 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 15:37:24.063408 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.virt.hardware [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 15:37:24.072907 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:24.073346 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:24.074135 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:24.074588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:24.091451 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Getting quotas for project 141bd2be69f243aa926f28b96eb6f0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 15:37:24.095848 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.quota [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Getting quotas for user 7d53405e3f88439f81b67106ad98adc2 and project 141bd2be69f243aa926f28b96eb6f0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 15:37:24.151747 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Going to run 1 instances... {{(pid=117806) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 15:37:24.153813 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1a17bd5-312d-4698-aef2-5047b65cafa9',volume_size=None,volume_type=None)] {{(pid=117806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 15:37:24.277599 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-b005a55f-aa4a-4162-a310-4fd56c43b8f1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.825291 Jun 03 15:37:24.278229 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 556/1088] 10.222.0.93 () {60 vars in 1146 bytes} [Fri Jun 3 15:37:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 15:37:24.286940 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2bcf7f1-3d82-4ae6-abc6-8701cfeb9d9d] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 03 15:37:24.287712 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=23 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:37:24.288446 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=46 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:37:24.292438 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-61bece96-26fb-4f95-82e3-853229c0887a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:24.293043 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-61bece96-26fb-4f95-82e3-853229c0887a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:24.457218 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-61bece96-26fb-4f95-82e3-853229c0887a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:24.463912 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-61bece96-26fb-4f95-82e3-853229c0887a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1095 microversion: 2.1 time: 0.178925 Jun 03 15:37:24.464486 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 533/1089] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:24 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1095 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:25.483297 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-bfa4b9df-f979-47b5-a83c-1966f4c493ad tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:25.484064 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-bfa4b9df-f979-47b5-a83c-1966f4c493ad tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:25.491664 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bfa4b9df-f979-47b5-a83c-1966f4c493ad tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:25.492110 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bfa4b9df-f979-47b5-a83c-1966f4c493ad tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:25.492885 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bfa4b9df-f979-47b5-a83c-1966f4c493ad tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:25.493315 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-bfa4b9df-f979-47b5-a83c-1966f4c493ad tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:25.557521 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-bfa4b9df-f979-47b5-a83c-1966f4c493ad tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:25.565094 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-bfa4b9df-f979-47b5-a83c-1966f4c493ad tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1211 microversion: 2.1 time: 0.086329 Jun 03 15:37:25.565672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 557/1090] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:25 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:26.583555 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-11817b5b-802b-4bd3-a52c-299e13cd94c1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:26.584624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-11817b5b-802b-4bd3-a52c-299e13cd94c1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:26.599424 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2bcf7f1-3d82-4ae6-abc6-8701cfeb9d9d] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 38668. Jun 03 15:37:26.602228 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-11817b5b-802b-4bd3-a52c-299e13cd94c1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:26.603321 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-11817b5b-802b-4bd3-a52c-299e13cd94c1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:26.604316 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-11817b5b-802b-4bd3-a52c-299e13cd94c1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:26.604914 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-11817b5b-802b-4bd3-a52c-299e13cd94c1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:26.803327 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-11817b5b-802b-4bd3-a52c-299e13cd94c1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:26.812004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-11817b5b-802b-4bd3-a52c-299e13cd94c1 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.233079 Jun 03 15:37:26.812531 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 534/1091] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:26 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:26.936981 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-c061473b-7c74-4072-8066-97d1fde082ec req-69661954-1127-4c26-a71d-a36e369d51b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fa3c43-75ef-43ec-a439-6adcfec7b6b5", "tag": "822a6686-2a8c-4ed3-91ff-ede92da2e3c0"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:37:26.946132 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-c061473b-7c74-4072-8066-97d1fde082ec req-69661954-1127-4c26-a71d-a36e369d51b2 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:26.946716 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-c061473b-7c74-4072-8066-97d1fde082ec req-69661954-1127-4c26-a71d-a36e369d51b2 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:26.959594 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-c061473b-7c74-4072-8066-97d1fde082ec req-69661954-1127-4c26-a71d-a36e369d51b2 service nova] Creating event network-changed:822a6686-2a8c-4ed3-91ff-ede92da2e3c0 for instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 on hv-cinder-83124 Jun 03 15:37:26.964702 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-c061473b-7c74-4072-8066-97d1fde082ec req-69661954-1127-4c26-a71d-a36e369d51b2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108848 Jun 03 15:37:26.965631 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 558/1092] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:37:27.829192 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-98cea644-222e-481a-a82b-26f11ec97779 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:27.830283 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-98cea644-222e-481a-a82b-26f11ec97779 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:27.837389 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98cea644-222e-481a-a82b-26f11ec97779 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:27.837835 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98cea644-222e-481a-a82b-26f11ec97779 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:27.838626 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98cea644-222e-481a-a82b-26f11ec97779 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:27.839062 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-98cea644-222e-481a-a82b-26f11ec97779 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:28.069743 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-98cea644-222e-481a-a82b-26f11ec97779 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:28.077459 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-98cea644-222e-481a-a82b-26f11ec97779 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.252182 Jun 03 15:37:28.078106 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 535/1093] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:27 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:29.095986 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-4eadee5a-175f-42c5-8735-bd901f3de6cf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:29.096789 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-4eadee5a-175f-42c5-8735-bd901f3de6cf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:29.103118 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4eadee5a-175f-42c5-8735-bd901f3de6cf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:29.103589 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4eadee5a-175f-42c5-8735-bd901f3de6cf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:29.104331 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4eadee5a-175f-42c5-8735-bd901f3de6cf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:29.104770 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-4eadee5a-175f-42c5-8735-bd901f3de6cf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:29.233707 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-4eadee5a-175f-42c5-8735-bd901f3de6cf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:29.241689 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-4eadee5a-175f-42c5-8735-bd901f3de6cf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.151062 Jun 03 15:37:29.242267 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 559/1094] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:29 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:30.258198 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-5ce23cb9-d8f0-4dd0-9a91-6d0de5f9320e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:30.258836 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-5ce23cb9-d8f0-4dd0-9a91-6d0de5f9320e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:30.265570 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5ce23cb9-d8f0-4dd0-9a91-6d0de5f9320e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:30.266014 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5ce23cb9-d8f0-4dd0-9a91-6d0de5f9320e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:30.266799 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5ce23cb9-d8f0-4dd0-9a91-6d0de5f9320e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:30.267231 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-5ce23cb9-d8f0-4dd0-9a91-6d0de5f9320e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:30.401316 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-5ce23cb9-d8f0-4dd0-9a91-6d0de5f9320e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:30.409428 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-5ce23cb9-d8f0-4dd0-9a91-6d0de5f9320e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.155059 Jun 03 15:37:30.409985 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 536/1095] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:30 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:31.426424 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-e6764a6a-3d38-46a0-9ca1-daa79b1898ee tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:31.427062 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-e6764a6a-3d38-46a0-9ca1-daa79b1898ee tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:31.433588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6764a6a-3d38-46a0-9ca1-daa79b1898ee tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:31.434038 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6764a6a-3d38-46a0-9ca1-daa79b1898ee tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:31.434836 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6764a6a-3d38-46a0-9ca1-daa79b1898ee tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:31.435274 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-e6764a6a-3d38-46a0-9ca1-daa79b1898ee tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:31.571073 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-e6764a6a-3d38-46a0-9ca1-daa79b1898ee tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:31.578635 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-e6764a6a-3d38-46a0-9ca1-daa79b1898ee tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.156609 Jun 03 15:37:31.579200 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 560/1096] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:31 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:32.595593 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-820ea447-ddd4-47e0-9127-60e163705e4d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:32.596259 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-820ea447-ddd4-47e0-9127-60e163705e4d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:32.602920 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-820ea447-ddd4-47e0-9127-60e163705e4d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:32.603370 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-820ea447-ddd4-47e0-9127-60e163705e4d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:32.604137 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-820ea447-ddd4-47e0-9127-60e163705e4d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:32.604570 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-820ea447-ddd4-47e0-9127-60e163705e4d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:32.737782 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-820ea447-ddd4-47e0-9127-60e163705e4d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:32.746178 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-820ea447-ddd4-47e0-9127-60e163705e4d tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.154469 Jun 03 15:37:32.746785 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 537/1097] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:32 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:33.764038 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-11caf2f9-d52c-4ae7-8e74-f8d62519cbcf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:33.764713 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-11caf2f9-d52c-4ae7-8e74-f8d62519cbcf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:33.771981 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-11caf2f9-d52c-4ae7-8e74-f8d62519cbcf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:33.772431 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-11caf2f9-d52c-4ae7-8e74-f8d62519cbcf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:33.773200 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-11caf2f9-d52c-4ae7-8e74-f8d62519cbcf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:33.773633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-11caf2f9-d52c-4ae7-8e74-f8d62519cbcf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:33.904373 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-11caf2f9-d52c-4ae7-8e74-f8d62519cbcf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:33.911975 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-11caf2f9-d52c-4ae7-8e74-f8d62519cbcf tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.152074 Jun 03 15:37:33.912560 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 561/1098] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:33 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:34.929265 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-6287bba8-31a9-4008-bc17-1f3b94a5d9cb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:34.929960 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-6287bba8-31a9-4008-bc17-1f3b94a5d9cb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:34.932444 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell0:SELECT=2 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:37:34.939303 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6287bba8-31a9-4008-bc17-1f3b94a5d9cb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:34.939742 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6287bba8-31a9-4008-bc17-1f3b94a5d9cb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:34.940565 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6287bba8-31a9-4008-bc17-1f3b94a5d9cb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:34.940979 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-6287bba8-31a9-4008-bc17-1f3b94a5d9cb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:35.086153 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-6287bba8-31a9-4008-bc17-1f3b94a5d9cb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:35.094220 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-6287bba8-31a9-4008-bc17-1f3b94a5d9cb tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.168885 Jun 03 15:37:35.094846 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 538/1099] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:34 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:36.112558 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5873ea6b-3b15-4899-a415-c781a37e577e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:36.113265 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5873ea6b-3b15-4899-a415-c781a37e577e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:36.115342 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=2 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:37:36.116174 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell0:SELECT=6 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:37:36.123201 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5873ea6b-3b15-4899-a415-c781a37e577e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:36.123656 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5873ea6b-3b15-4899-a415-c781a37e577e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:36.124592 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5873ea6b-3b15-4899-a415-c781a37e577e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:36.125105 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5873ea6b-3b15-4899-a415-c781a37e577e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:36.267248 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5873ea6b-3b15-4899-a415-c781a37e577e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:36.275311 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5873ea6b-3b15-4899-a415-c781a37e577e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.166662 Jun 03 15:37:36.275875 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 562/1100] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:36 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:37.292217 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7729ac38-5206-4e3a-82cc-717fe6e60106 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:37.292886 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7729ac38-5206-4e3a-82cc-717fe6e60106 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:37.299937 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7729ac38-5206-4e3a-82cc-717fe6e60106 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:37.300388 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7729ac38-5206-4e3a-82cc-717fe6e60106 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:37.301192 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7729ac38-5206-4e3a-82cc-717fe6e60106 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:37.301640 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7729ac38-5206-4e3a-82cc-717fe6e60106 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:37.431381 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7729ac38-5206-4e3a-82cc-717fe6e60106 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:37.438858 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7729ac38-5206-4e3a-82cc-717fe6e60106 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.150606 Jun 03 15:37:37.440004 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 539/1101] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:37 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:38.162649 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-157a0a48-d079-4829-932d-ae0c52d86ecd req-cabbf1c1-1412-42f9-b9cc-8c6a6ff03750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fa3c43-75ef-43ec-a439-6adcfec7b6b5", "name": "network-vif-plugged", "status": "completed", "tag": "822a6686-2a8c-4ed3-91ff-ede92da2e3c0"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:37:38.172142 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-157a0a48-d079-4829-932d-ae0c52d86ecd req-cabbf1c1-1412-42f9-b9cc-8c6a6ff03750 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:38.172614 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-157a0a48-d079-4829-932d-ae0c52d86ecd req-cabbf1c1-1412-42f9-b9cc-8c6a6ff03750 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:38.184671 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-157a0a48-d079-4829-932d-ae0c52d86ecd req-cabbf1c1-1412-42f9-b9cc-8c6a6ff03750 service nova] Creating event network-vif-plugged:822a6686-2a8c-4ed3-91ff-ede92da2e3c0 for instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 on hv-cinder-83124 Jun 03 15:37:38.190167 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-157a0a48-d079-4829-932d-ae0c52d86ecd req-cabbf1c1-1412-42f9-b9cc-8c6a6ff03750 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090049 Jun 03 15:37:38.191428 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 563/1102] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:37:38.456481 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-b2919811-2f60-4e36-b46d-0f5addd9d67f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:38.457154 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-b2919811-2f60-4e36-b46d-0f5addd9d67f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:38.463644 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b2919811-2f60-4e36-b46d-0f5addd9d67f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:38.464091 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b2919811-2f60-4e36-b46d-0f5addd9d67f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:38.464861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b2919811-2f60-4e36-b46d-0f5addd9d67f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:38.465325 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-b2919811-2f60-4e36-b46d-0f5addd9d67f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:38.593899 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-b2919811-2f60-4e36-b46d-0f5addd9d67f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:38.602019 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-b2919811-2f60-4e36-b46d-0f5addd9d67f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1266 microversion: 2.1 time: 0.149487 Jun 03 15:37:38.602602 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 540/1103] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:38 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:39.619083 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-d306bb29-39fd-43bb-8604-b8179611730a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:39.619775 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-d306bb29-39fd-43bb-8604-b8179611730a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:39.626004 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d306bb29-39fd-43bb-8604-b8179611730a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:39.626448 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d306bb29-39fd-43bb-8604-b8179611730a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:39.627954 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d306bb29-39fd-43bb-8604-b8179611730a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:39.628388 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-d306bb29-39fd-43bb-8604-b8179611730a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:39.759762 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-d306bb29-39fd-43bb-8604-b8179611730a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:39.767568 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-d306bb29-39fd-43bb-8604-b8179611730a tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1453 microversion: 2.1 time: 0.153133 Jun 03 15:37:39.768195 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 564/1104] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:39 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:39.784323 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-9077d79b-ff29-437f-96c0-8a9a45672498 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:37:39.784926 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-9077d79b-ff29-437f-96c0-8a9a45672498 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:37:39.791513 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9077d79b-ff29-437f-96c0-8a9a45672498 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:39.791962 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9077d79b-ff29-437f-96c0-8a9a45672498 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:39.792742 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9077d79b-ff29-437f-96c0-8a9a45672498 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:39.793174 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-9077d79b-ff29-437f-96c0-8a9a45672498 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:39.931813 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-9077d79b-ff29-437f-96c0-8a9a45672498 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:37:39.939687 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-9077d79b-ff29-437f-96c0-8a9a45672498 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1453 microversion: 2.1 time: 0.159654 Jun 03 15:37:39.940244 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 541/1105] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:37:39 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:37:41.687592 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-8506f6f2-95a6-4d07-b9d3-38d0cc2f2836 req-7fc05acb-da16-43e9-9dbf-e12664523a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fa3c43-75ef-43ec-a439-6adcfec7b6b5", "tag": "822a6686-2a8c-4ed3-91ff-ede92da2e3c0"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:37:41.696138 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-8506f6f2-95a6-4d07-b9d3-38d0cc2f2836 req-7fc05acb-da16-43e9-9dbf-e12664523a96 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:37:41.696588 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-8506f6f2-95a6-4d07-b9d3-38d0cc2f2836 req-7fc05acb-da16-43e9-9dbf-e12664523a96 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:37:41.708135 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-8506f6f2-95a6-4d07-b9d3-38d0cc2f2836 req-7fc05acb-da16-43e9-9dbf-e12664523a96 service nova] Creating event network-changed:822a6686-2a8c-4ed3-91ff-ede92da2e3c0 for instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 on hv-cinder-83124 Jun 03 15:37:41.713571 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-8506f6f2-95a6-4d07-b9d3-38d0cc2f2836 req-7fc05acb-da16-43e9-9dbf-e12664523a96 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089568 Jun 03 15:37:41.714148 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 565/1106] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:38:19.756947 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:38:19.757539 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Fri Jun 3 15:38:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:38:58.567429 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:38:58.568122 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Fri Jun 3 15:38:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:39:22.073830 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-8c6ede86-1847-44b0-96e5-de2d75bf1c01 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:22.075277 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8c6ede86-1847-44b0-96e5-de2d75bf1c01 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:22.075945 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:39:22.077156 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG dbcounter [-] [117806] Writing DB stats nova_cell1:SELECT=44 {{(pid=117806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:39:22.082059 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-72bc771e-5a92-4b87-971f-1f95d6f445c9 req-532b674e-6b5c-430a-8cc6-e12ea7119f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fa3c43-75ef-43ec-a439-6adcfec7b6b5", "tag": "822a6686-2a8c-4ed3-91ff-ede92da2e3c0"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:39:22.082362 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_api:SELECT=20 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:39:22.082895 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG dbcounter [-] [117805] Writing DB stats nova_cell1:SELECT=48 {{(pid=117805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 15:39:22.085013 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8c6ede86-1847-44b0-96e5-de2d75bf1c01 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:22.085570 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8c6ede86-1847-44b0-96e5-de2d75bf1c01 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:22.086590 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8c6ede86-1847-44b0-96e5-de2d75bf1c01 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:22.087101 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-8c6ede86-1847-44b0-96e5-de2d75bf1c01 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:22.095200 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-72bc771e-5a92-4b87-971f-1f95d6f445c9 req-532b674e-6b5c-430a-8cc6-e12ea7119f28 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:22.095715 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-72bc771e-5a92-4b87-971f-1f95d6f445c9 req-532b674e-6b5c-430a-8cc6-e12ea7119f28 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:22.109259 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-72bc771e-5a92-4b87-971f-1f95d6f445c9 req-532b674e-6b5c-430a-8cc6-e12ea7119f28 service nova] Creating event network-changed:822a6686-2a8c-4ed3-91ff-ede92da2e3c0 for instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 on hv-cinder-83124 Jun 03 15:39:22.115763 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-72bc771e-5a92-4b87-971f-1f95d6f445c9 req-532b674e-6b5c-430a-8cc6-e12ea7119f28 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042018 Jun 03 15:39:22.116916 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-8c6ede86-1847-44b0-96e5-de2d75bf1c01 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:39:22.117090 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 566/1107] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:39:22.219831 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-8c6ede86-1847-44b0-96e5-de2d75bf1c01 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "DELETE /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 204 len: 0 microversion: 2.1 time: 0.151462 Jun 03 15:39:22.220739 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 542/1108] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:39:22 2022] DELETE /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:39:22.235600 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-453ca260-a57a-4f6e-b476-aab9871b754f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:22.236997 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-453ca260-a57a-4f6e-b476-aab9871b754f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:22.244604 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-453ca260-a57a-4f6e-b476-aab9871b754f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:22.245673 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-453ca260-a57a-4f6e-b476-aab9871b754f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:22.247033 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-453ca260-a57a-4f6e-b476-aab9871b754f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:22.247701 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-453ca260-a57a-4f6e-b476-aab9871b754f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:22.401195 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-453ca260-a57a-4f6e-b476-aab9871b754f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:39:22.411308 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-453ca260-a57a-4f6e-b476-aab9871b754f tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1578 microversion: 2.1 time: 0.184974 Jun 03 15:39:22.411960 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 567/1109] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:39:22 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:39:23.433132 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-92e54b47-6ca7-4200-868b-aae4476d86b5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:23.434320 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-92e54b47-6ca7-4200-868b-aae4476d86b5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:23.440615 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-92e54b47-6ca7-4200-868b-aae4476d86b5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:23.441064 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-92e54b47-6ca7-4200-868b-aae4476d86b5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:23.441830 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-92e54b47-6ca7-4200-868b-aae4476d86b5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:23.442266 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-92e54b47-6ca7-4200-868b-aae4476d86b5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:23.664482 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-92e54b47-6ca7-4200-868b-aae4476d86b5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:39:23.673233 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-92e54b47-6ca7-4200-868b-aae4476d86b5 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1578 microversion: 2.1 time: 0.244495 Jun 03 15:39:23.674210 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 543/1110] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:39:23 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:39:24.379981 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-757d80fd-25a9-46b5-bb5d-ac2090d95812 req-2f9725ff-7822-4efa-be59-a69bbb577d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fa3c43-75ef-43ec-a439-6adcfec7b6b5", "name": "network-vif-deleted", "tag": "822a6686-2a8c-4ed3-91ff-ede92da2e3c0"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:39:24.389020 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-757d80fd-25a9-46b5-bb5d-ac2090d95812 req-2f9725ff-7822-4efa-be59-a69bbb577d84 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:24.389463 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-757d80fd-25a9-46b5-bb5d-ac2090d95812 req-2f9725ff-7822-4efa-be59-a69bbb577d84 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:24.400945 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-757d80fd-25a9-46b5-bb5d-ac2090d95812 req-2f9725ff-7822-4efa-be59-a69bbb577d84 service nova] Creating event network-vif-deleted:822a6686-2a8c-4ed3-91ff-ede92da2e3c0 for instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 on hv-cinder-83124 Jun 03 15:39:24.406419 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-757d80fd-25a9-46b5-bb5d-ac2090d95812 req-2f9725ff-7822-4efa-be59-a69bbb577d84 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031161 Jun 03 15:39:24.407071 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 568/1111] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:39:24.696666 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-7a5e1986-451b-4fad-8084-ee256b6d17fe tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:24.699225 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-7a5e1986-451b-4fad-8084-ee256b6d17fe tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:24.708071 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7a5e1986-451b-4fad-8084-ee256b6d17fe tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:24.708765 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7a5e1986-451b-4fad-8084-ee256b6d17fe tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:24.710070 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7a5e1986-451b-4fad-8084-ee256b6d17fe tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:24.710879 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-7a5e1986-451b-4fad-8084-ee256b6d17fe tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:24.816078 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-7a5e1986-451b-4fad-8084-ee256b6d17fe tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:39:24.826945 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-7a5e1986-451b-4fad-8084-ee256b6d17fe tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 200 len: 1226 microversion: 2.1 time: 0.138938 Jun 03 15:39:24.827603 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 544/1112] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:39:24 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 1226 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:39:25.846007 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c66bb78f-4432-4687-9671-2278f1a37e22 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:25.846645 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-c66bb78f-4432-4687-9671-2278f1a37e22 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 71fa3c43-75ef-43ec-a439-6adcfec7b6b5] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:25.852956 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c66bb78f-4432-4687-9671-2278f1a37e22 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:25.853406 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c66bb78f-4432-4687-9671-2278f1a37e22 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:25.854176 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c66bb78f-4432-4687-9671-2278f1a37e22 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:25.854639 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-c66bb78f-4432-4687-9671-2278f1a37e22 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:25.868136 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-c66bb78f-4432-4687-9671-2278f1a37e22 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] HTTP exception thrown: Instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 could not be found. Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c66bb78f-4432-4687-9671-2278f1a37e22 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Request method failure captured: Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 HTTP/1.1 Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimilTc42dAOjXGY-wUJVZyhb00vNpHWAeXziGl2xw-3CUEazCViJ7OwsSBbd-qS97uF5UYzTKZQdY9y7QsUtCEcb2B6U1XtXQSnw0YwRFsMbU3aRe-nxvt_yuXONdHLbNy0YXQp2OjpjpKJeVJnExasSrDWXrsBSgkSRPgKoJ178gvQo Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 141bd2be69f243aa926f28b96eb6f0d5 Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:39:25.869761 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/141bd2be69f243aa926f28b96eb6f0d5"}]}] Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 141bd2be69f243aa926f28b96eb6f0d5 Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-TestVolumeBootPattern-974669227-project Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 7d53405e3f88439f81b67106ad98adc2 Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-TestVolumeBootPattern-974669227-project Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 could not be found. Jun 03 15:39:25.871544 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '71fa3c43-75ef-43ec-a439-6adcfec7b6b5'} Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 could not be found. Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:39:25.872510 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 could not be found. Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 could not be found. Jun 03 15:39:25.874193 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:25.875811 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-c66bb78f-4432-4687-9671-2278f1a37e22 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Returning 404 to user: Instance 71fa3c43-75ef-43ec-a439-6adcfec7b6b5 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:39:25.875811 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-c66bb78f-4432-4687-9671-2278f1a37e22 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5" status: 404 len: 111 microversion: 2.1 time: 0.030611 Jun 03 15:39:25.875811 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 569/1113] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:39:25 2022] GET /compute/v2.1/servers/71fa3c43-75ef-43ec-a439-6adcfec7b6b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 15:39:28.987861 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-24030c8f-6865-4ee1-9acb-4a84c56eb12b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:28.989071 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-24030c8f-6865-4ee1-9acb-4a84c56eb12b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:28.989370 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-38b7ba2a-f7d1-469c-bb50-b7999f453bbd req-bf3400ce-69e9-4e85-b4c1-136cb0d1d52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b", "tag": "19ee1e44-f976-459e-a5b3-bb93ee091e6c"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:39:28.995044 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-24030c8f-6865-4ee1-9acb-4a84c56eb12b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:28.995494 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-24030c8f-6865-4ee1-9acb-4a84c56eb12b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:28.996289 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-24030c8f-6865-4ee1-9acb-4a84c56eb12b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:28.996896 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-24030c8f-6865-4ee1-9acb-4a84c56eb12b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:28.998792 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-38b7ba2a-f7d1-469c-bb50-b7999f453bbd req-bf3400ce-69e9-4e85-b4c1-136cb0d1d52a service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:28.999277 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-38b7ba2a-f7d1-469c-bb50-b7999f453bbd req-bf3400ce-69e9-4e85-b4c1-136cb0d1d52a service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:29.015665 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-38b7ba2a-f7d1-469c-bb50-b7999f453bbd req-bf3400ce-69e9-4e85-b4c1-136cb0d1d52a service nova] Creating event network-changed:19ee1e44-f976-459e-a5b3-bb93ee091e6c for instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b on hv-cinder-83124 Jun 03 15:39:29.021793 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-38b7ba2a-f7d1-469c-bb50-b7999f453bbd req-bf3400ce-69e9-4e85-b4c1-136cb0d1d52a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036723 Jun 03 15:39:29.024515 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 570/1114] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 15:39:29.027930 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-24030c8f-6865-4ee1-9acb-4a84c56eb12b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Going to try to terminate instance {{(pid=117805) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 15:39:29.140548 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-24030c8f-6865-4ee1-9acb-4a84c56eb12b tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "DELETE /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 204 len: 0 microversion: 2.1 time: 0.157365 Jun 03 15:39:29.141628 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 545/1115] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:39:28 2022] DELETE /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 15:39:29.150920 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-5c64e0b5-5e25-4690-aa76-95bb10444f32 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:29.151619 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-5c64e0b5-5e25-4690-aa76-95bb10444f32 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:29.159259 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c64e0b5-5e25-4690-aa76-95bb10444f32 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:29.159716 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c64e0b5-5e25-4690-aa76-95bb10444f32 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:29.160489 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c64e0b5-5e25-4690-aa76-95bb10444f32 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:29.161144 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-5c64e0b5-5e25-4690-aa76-95bb10444f32 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:29.352461 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.policy [None req-5c64e0b5-5e25-4690-aa76-95bb10444f32 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117806) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:39:29.361904 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-5c64e0b5-5e25-4690-aa76-95bb10444f32 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1578 microversion: 2.1 time: 0.215744 Jun 03 15:39:29.362469 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 571/1116] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:39:29 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1578 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:39:30.380768 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-a3e28334-8145-4431-9f3d-c9f0f962ecf9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:30.381477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-a3e28334-8145-4431-9f3d-c9f0f962ecf9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:30.388559 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a3e28334-8145-4431-9f3d-c9f0f962ecf9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:30.389018 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a3e28334-8145-4431-9f3d-c9f0f962ecf9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:30.389827 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a3e28334-8145-4431-9f3d-c9f0f962ecf9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:30.390269 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-a3e28334-8145-4431-9f3d-c9f0f962ecf9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:30.549337 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-a3e28334-8145-4431-9f3d-c9f0f962ecf9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:39:30.559612 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-a3e28334-8145-4431-9f3d-c9f0f962ecf9 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1578 microversion: 2.1 time: 0.182973 Jun 03 15:39:30.560083 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 546/1117] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:39:30 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:39:31.190390 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [req-9ec38061-02b7-4dce-820a-f846e996810c req-e64aa8a4-abb3-4a22-aba0-6a8eeab76d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b", "name": "network-vif-deleted", "tag": "19ee1e44-f976-459e-a5b3-bb93ee091e6c"}]} {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 15:39:31.199203 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-9ec38061-02b7-4dce-820a-f846e996810c req-e64aa8a4-abb3-4a22-aba0-6a8eeab76d02 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:31.199644 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [req-9ec38061-02b7-4dce-820a-f846e996810c req-e64aa8a4-abb3-4a22-aba0-6a8eeab76d02 service nova] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:31.212355 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.compute.server_external_events [req-9ec38061-02b7-4dce-820a-f846e996810c req-e64aa8a4-abb3-4a22-aba0-6a8eeab76d02 service nova] Creating event network-vif-deleted:19ee1e44-f976-459e-a5b3-bb93ee091e6c for instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b on hv-cinder-83124 Jun 03 15:39:31.217672 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [req-9ec38061-02b7-4dce-820a-f846e996810c req-e64aa8a4-abb3-4a22-aba0-6a8eeab76d02 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031021 Jun 03 15:39:31.218290 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 572/1118] 10.222.0.93 () {64 vars in 1317 bytes} [Fri Jun 3 15:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 15:39:31.577950 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:31.579344 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:31.587402 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:31.587853 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:31.588734 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:31.589532 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:31.627280 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:31.627724 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:31.628177 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.objects.instance [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lazy-loading 'fault' on Instance uuid 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b {{(pid=117805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 15:39:31.676424 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.policy [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d53405e3f88439f81b67106ad98adc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bd2be69f243aa926f28b96eb6f0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117805) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 15:39:31.684252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-d9a445e2-aee1-42a2-8f1e-af7fd2d2b781 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 200 len: 1231 microversion: 2.1 time: 0.110161 Jun 03 15:39:31.684820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 547/1119] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:39:31 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 1231 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 15:39:32.704236 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-dc63ed02-1ea7-4cd3-8d62-8414daca3941 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:32.704948 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-dc63ed02-1ea7-4cd3-8d62-8414daca3941 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:32.711686 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc63ed02-1ea7-4cd3-8d62-8414daca3941 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:32.712134 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc63ed02-1ea7-4cd3-8d62-8414daca3941 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:32.712918 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc63ed02-1ea7-4cd3-8d62-8414daca3941 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:32.713378 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-dc63ed02-1ea7-4cd3-8d62-8414daca3941 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:32.728222 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-dc63ed02-1ea7-4cd3-8d62-8414daca3941 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] HTTP exception thrown: Instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b could not be found. Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-dc63ed02-1ea7-4cd3-8d62-8414daca3941 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Request method failure captured: Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b HTTP/1.1 Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimilTc42dAOjXGY-wUJVZyhb00vNpHWAeXziGl2xw-3CUEazCViJ7OwsSBbd-qS97uF5UYzTKZQdY9y7QsUtCEcb2B6U1XtXQSnw0YwRFsMbU3aRe-nxvt_yuXONdHLbNy0YXQp2OjpjpKJeVJnExasSrDWXrsBSgkSRPgKoJ178gvQo Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 141bd2be69f243aa926f28b96eb6f0d5 Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:39:32.729842 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/141bd2be69f243aa926f28b96eb6f0d5"}]}] Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 141bd2be69f243aa926f28b96eb6f0d5 Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-TestVolumeBootPattern-974669227-project Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 7d53405e3f88439f81b67106ad98adc2 Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-TestVolumeBootPattern-974669227-project Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b could not be found. Jun 03 15:39:32.731675 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b'} Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b could not be found. Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:39:32.732633 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b could not be found. Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b could not be found. Jun 03 15:39:32.734442 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:32.736000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-dc63ed02-1ea7-4cd3-8d62-8414daca3941 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Returning 404 to user: Instance 838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:39:32.736000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-dc63ed02-1ea7-4cd3-8d62-8414daca3941 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b" status: 404 len: 111 microversion: 2.1 time: 0.032909 Jun 03 15:39:32.736000 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 573/1120] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:39:32 2022] GET /compute/v2.1/servers/838ee0a7-1cf0-40fa-b0c6-1a37e9c54f1b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:39:33.216849 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c860e969-ec6e-4727-94d9-c55cef6b7708 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:33.217415 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.compute.api [None req-c860e969-ec6e-4727-94d9-c55cef6b7708 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117805) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:33.224252 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c860e969-ec6e-4727-94d9-c55cef6b7708 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:33.224701 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c860e969-ec6e-4727-94d9-c55cef6b7708 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:33.225486 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c860e969-ec6e-4727-94d9-c55cef6b7708 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:33.225923 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG oslo_concurrency.lockutils [None req-c860e969-ec6e-4727-94d9-c55cef6b7708 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:33.240596 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.wsgi [None req-c860e969-ec6e-4727-94d9-c55cef6b7708 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] HTTP exception thrown: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c860e969-ec6e-4727-94d9-c55cef6b7708 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Request method failure captured: Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: request: DELETE /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 HTTP/1.1 Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept: application/json Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Accept-Encoding: identity Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Connection: close Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Length: 0 Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Content-Type: application/json Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Host: 10.222.0.93 Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Openstack-System-Scope: None Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: User-Agent: python-urllib3/1.26.9 Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Auth-Token: gAAAAABimilTc42dAOjXGY-wUJVZyhb00vNpHWAeXziGl2xw-3CUEazCViJ7OwsSBbd-qS97uF5UYzTKZQdY9y7QsUtCEcb2B6U1XtXQSnw0YwRFsMbU3aRe-nxvt_yuXONdHLbNy0YXQp2OjpjpKJeVJnExasSrDWXrsBSgkSRPgKoJ178gvQo Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Id: None Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Domain-Name: None Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Identity-Status: Confirmed Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Is-Admin-Project: True Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Id: default Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Domain-Name: Default Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Id: 141bd2be69f243aa926f28b96eb6f0d5 Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Project-Name: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Role: reader,member Jun 03 15:39:33.242264 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Roles: reader,member Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/141bd2be69f243aa926f28b96eb6f0d5"}]}] Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Id: 141bd2be69f243aa926f28b96eb6f0d5 Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-Tenant-Name: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User: tempest-TestVolumeBootPattern-974669227-project Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Id: default Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Domain-Name: Default Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Id: 7d53405e3f88439f81b67106ad98adc2 Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: X-User-Name: tempest-TestVolumeBootPattern-974669227-project Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: method: > Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: exception: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:39:33.243820 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: action_args: {'id': '0b12e6d4-7911-4c08-a28d-aadf2beda784'} Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:39:33.244624 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:39:33.246181 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: ERROR nova.api.openstack.wsgi Jun 03 15:39:33.247955 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-c860e969-ec6e-4727-94d9-c55cef6b7708 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Returning 404 to user: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. {{(pid=117805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:39:33.247955 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-c860e969-ec6e-4727-94d9-c55cef6b7708 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 404 len: 111 microversion: 2.1 time: 0.030868 Jun 03 15:39:33.247955 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 548/1121] 10.222.0.93 () {58 vars in 1238 bytes} [Fri Jun 3 15:39:33 2022] DELETE /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:39:33.252990 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-aa35dd9b-f44b-4052-a65b-de11f6c93090 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '>' {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:33.253601 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.compute.api [None req-aa35dd9b-f44b-4052-a65b-de11f6c93090 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] [instance: 0b12e6d4-7911-4c08-a28d-aadf2beda784] Fetching instance by UUID {{(pid=117806) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 15:39:33.259797 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aa35dd9b-f44b-4052-a65b-de11f6c93090 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:33.260281 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aa35dd9b-f44b-4052-a65b-de11f6c93090 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:33.261023 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aa35dd9b-f44b-4052-a65b-de11f6c93090 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 15:39:33.261458 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG oslo_concurrency.lockutils [None req-aa35dd9b-f44b-4052-a65b-de11f6c93090 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Lock "6d0d96d0-a575-4f71-9a90-c4114fd48e50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 15:39:33.276223 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.wsgi [None req-aa35dd9b-f44b-4052-a65b-de11f6c93090 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] HTTP exception thrown: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-aa35dd9b-f44b-4052-a65b-de11f6c93090 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Request method failure captured: Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: request: GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 HTTP/1.1 Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept: application/json Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Accept-Encoding: identity Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Connection: close Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Length: 0 Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Content-Type: application/json Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Host: 10.222.0.93 Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Openstack-System-Scope: None Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: User-Agent: python-urllib3/1.26.9 Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Auth-Token: gAAAAABimilTc42dAOjXGY-wUJVZyhb00vNpHWAeXziGl2xw-3CUEazCViJ7OwsSBbd-qS97uF5UYzTKZQdY9y7QsUtCEcb2B6U1XtXQSnw0YwRFsMbU3aRe-nxvt_yuXONdHLbNy0YXQp2OjpjpKJeVJnExasSrDWXrsBSgkSRPgKoJ178gvQo Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Id: None Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Domain-Name: None Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Identity-Status: Confirmed Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Is-Admin-Project: True Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Id: default Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Domain-Name: Default Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Id: 141bd2be69f243aa926f28b96eb6f0d5 Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Project-Name: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Role: reader,member Jun 03 15:39:33.277776 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Roles: reader,member Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_141bd2be69f243aa926f28b96eb6f0d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/141bd2be69f243aa926f28b96eb6f0d5"}]}] Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Id: 141bd2be69f243aa926f28b96eb6f0d5 Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-Tenant-Name: tempest-TestVolumeBootPattern-974669227 Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User: tempest-TestVolumeBootPattern-974669227-project Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Id: default Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Domain-Name: Default Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Id: 7d53405e3f88439f81b67106ad98adc2 Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: X-User-Name: tempest-TestVolumeBootPattern-974669227-project Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: method: > Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: exception: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:39:33.280026 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: action_args: {'id': '0b12e6d4-7911-4c08-a28d-aadf2beda784'} Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: {{(pid=117806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 15:39:33.281432 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. Jun 03 15:39:33.284034 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: ERROR nova.api.openstack.wsgi Jun 03 15:39:33.286524 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: DEBUG nova.api.openstack.wsgi [None req-aa35dd9b-f44b-4052-a65b-de11f6c93090 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Returning 404 to user: Instance 0b12e6d4-7911-4c08-a28d-aadf2beda784 could not be found. {{(pid=117806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 15:39:33.286524 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO nova.api.openstack.requestlog [None req-aa35dd9b-f44b-4052-a65b-de11f6c93090 tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784" status: 404 len: 111 microversion: 2.1 time: 0.030609 Jun 03 15:39:33.286524 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: [pid: 117806|app: 0|req: 574/1122] 10.222.0.93 () {58 vars in 1235 bytes} [Fri Jun 3 15:39:33 2022] GET /compute/v2.1/servers/0b12e6d4-7911-4c08-a28d-aadf2beda784 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 15:39:34.607293 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: DEBUG nova.api.openstack.wsgi [None req-1a5eb926-2373-4828-ac17-db7c2a03a75e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] Calling method '.version_select at 0x7f92f0de4790>' {{(pid=117805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 15:39:34.637514 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO nova.api.openstack.requestlog [None req-1a5eb926-2373-4828-ac17-db7c2a03a75e tempest-TestVolumeBootPattern-974669227 tempest-TestVolumeBootPattern-974669227-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1350769796" status: 202 len: 0 microversion: 2.1 time: 0.035870 Jun 03 15:39:34.638014 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: [pid: 117805|app: 0|req: 549/1123] 10.222.0.93 () {58 vars in 1262 bytes} [Fri Jun 3 15:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1350769796 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 15:40:11.592987 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:40:11.593618 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Fri Jun 3 15:40:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:40:24.257748 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:40:24.258449 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Fri Jun 3 15:40:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:41:39.766477 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:41:39.767114 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Fri Jun 3 15:41:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:41:43.793497 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:41:43.794342 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Fri Jun 3 15:41:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:41:54.102759 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:41:54.103309 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Fri Jun 3 15:41:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:42:18.575591 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:42:18.576236 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Fri Jun 3 15:42:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:43:31.601872 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:43:31.602648 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Fri Jun 3 15:43:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:43:44.267517 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:43:44.268187 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Fri Jun 3 15:43:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:44:59.774896 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:44:59.775424 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Fri Jun 3 15:44:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:45:03.801890 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:45:03.802560 dv-cinder-831247-16-iscsi devstack@n-api.service[117805]: Fri Jun 3 15:45:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 15:45:14.112074 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 15:45:14.112646 dv-cinder-831247-16-iscsi devstack@n-api.service[117806]: Fri Jun 3 15:45:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!